Jul 06 11:26:47.262452 ip-10-0-138-178 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 11:26:47.262466 ip-10-0-138-178 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 11:26:47.262474 ip-10-0-138-178 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 11:26:47.262851 ip-10-0-138-178 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 11:26:57.511704 ip-10-0-138-178 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 11:26:57.511724 ip-10-0-138-178 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5fcdc19ae55d4e1a96044a83fd0a19b3 --
Jul 06 11:28:43.157393 ip-10-0-138-178 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 11:28:43.666346 ip-10-0-138-178 systemd[1]: Started Kubernetes Kubelet.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.583530    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.588980    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.588999    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589003    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589007    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589010    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589013    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589016    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.668670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589019    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589022    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589024    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589027    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589031    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589034    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589037    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589039    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589042    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589045    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589047    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589050    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589053    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589056    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589059    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589062    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589064    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589067    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589069    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.669938 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589074    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589079    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589082    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589085    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589088    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589091    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589094    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589097    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589100    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589103    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589106    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589109    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589111    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589115    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589118    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589121    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589125    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589127    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589130    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589147    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.671016 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589150    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589153    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589156    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589159    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589162    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589164    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589167    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589170    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589172    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589175    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589177    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589180    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589183    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589185    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589188    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589191    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589194    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589197    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589201    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589204    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.671896 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589206    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589209    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589211    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589214    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589216    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589219    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589221    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589224    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589226    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589229    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589231    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589234    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589238    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589242    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589246    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589251    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589254    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589258    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589261    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.672773 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589263    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589266    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589269    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589272    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589274    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589277    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589280    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589282    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589286    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589288    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589291    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589293    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589296    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.589298    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590070    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590076    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590080    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590082    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590085    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590088    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.673576 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590091    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590094    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590097    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590100    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590102    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590105    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590108    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590111    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590114    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590117    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590120    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590123    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590125    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590128    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590130    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590148    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590151    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590154    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590157    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590159    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.674446 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590162    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590171    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590174    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590177    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590179    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590182    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590186    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590188    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590191    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590195    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590198    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590201    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590204    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590206    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590209    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590211    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590214    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590216    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590219    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590221    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.678931 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590229    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590232    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590236    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590240    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590243    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590246    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590249    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590252    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590255    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590258    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590260    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590263    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590266    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590268    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590272    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590275    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590279    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590283    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590286    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.679792 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590289    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590291    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590294    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590296    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590299    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590302    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590304    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590307    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590309    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590312    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590315    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590318    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590320    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590326    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590329    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590331    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590334    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590336    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590339    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590342    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.686617 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590344    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590347    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590349    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590352    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590354    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590357    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590359    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590362    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590365    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590368    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590371    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590373    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590375    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590378    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590780    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590785    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590787    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590790    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590793    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590795    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.687474 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590798    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590801    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590803    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590806    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590808    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590813    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590816    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590819    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590822    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590824    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590827    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590831    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590833    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590836    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590838    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590841    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590843    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590846    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590848    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590851    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.688325 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590854    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590857    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590860    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590862    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590867    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590870    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590874    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590878    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590881    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590884    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590887    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590890    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590892    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590895    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590898    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590900    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590903    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590907    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590911    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590913    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.689379 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590916    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590918    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590921    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590924    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590926    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590929    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590931    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590934    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590936    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590939    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590941    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590944    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590947    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590951    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590953    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590956    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590958    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590961    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590963    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.690445 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590965    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590968    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590971    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590973    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590977    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590980    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590982    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590985    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590987    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590989    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590993    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590996    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.590998    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591001    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591003    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591006    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591008    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591011    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591013    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591016    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.691307 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591019    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591021    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591024    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591028    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591032    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591035    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591038    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591041    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591044    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591047    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591050    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591052    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591054    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591057    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591149    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591160    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591172    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591176    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591180    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591184    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591188    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 11:28:43.692166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591192    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591197    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591200    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591203    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591207    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591210    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591213    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591216    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591219    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591222    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591225    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591230    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591233    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591236    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591239    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591243    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591246    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591249    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591252    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591256    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591259    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591262    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591265    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591269    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 11:28:43.693020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591272    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591276    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591279    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591283    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591286    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591288    2581 flags.go:64] FLAG: --enable-server="true"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591291    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591296    2581 flags.go:64] FLAG: --event-burst="100"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591299    2581 flags.go:64] FLAG: --event-qps="50"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591303    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591306    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591309    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591313    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591316    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591319    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591322    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591325    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591328    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591331    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591334    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591337    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591340    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591343    2581 flags.go:64] FLAG: --feature-gates=""
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591387    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591391    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 11:28:43.694092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591395    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591399    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591402    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591405    2581 flags.go:64] FLAG: --help="false"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591409    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-138-178.ec2.internal"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591412    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591415    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591418    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591422    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591425    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591430    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591432    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591435    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591438    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591441    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591444    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591449    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591452    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591455    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591458    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591461    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591464    2581 flags.go:64] FLAG: --lock-file=""
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591467    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591470    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 11:28:43.695414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591473    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591479    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591482    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591484    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591487    2581 flags.go:64] FLAG: --logging-format="text"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591490    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591494    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591496    2581 flags.go:64] FLAG: --manifest-url=""
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591499    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591504    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591507    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591511    2581 flags.go:64] FLAG: --max-pods="110"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591515    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591518    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591521    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591524    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591528    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591531    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591535    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591545    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591548    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591551    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591554    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 06 11:28:43.696467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591557    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591563    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591567    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591570    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591574    2581 flags.go:64] FLAG: --port="10250"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591577    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591579    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02e1bc2d048fd555c"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591583    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591586    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591588    2581 flags.go:64] FLAG: --register-node="true"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591591    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591595    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591598    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591601    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591604    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591608    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591611    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591614    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591617    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591620    2581 flags.go:64] FLAG: --runonce="false"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591623    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591626    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591630    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591633    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591636    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591639    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 11:28:43.697535 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591642    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591647    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591650    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591652    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591655    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591658    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591661    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591664    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591668    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591674    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591677    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591680    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591684    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591687    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591689    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591692    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591695    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591698    2581 flags.go:64] FLAG: --v="2"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591702    2581 flags.go:64] FLAG: --version="false"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591706    2581 flags.go:64] FLAG: --vmodule=""
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591709    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.591713    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591834    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591838    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.698596 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591841    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591844    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591847    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591850    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591853    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591863    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591865    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591868    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591871    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591875    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591877    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591880    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591882    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591886    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591890    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591893    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591898    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591901    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.803697 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591904    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591908    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591912    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591915    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591918    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591920    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591923    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591926    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591929    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591932    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591934    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591936    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591939    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591942    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591944    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591947    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591949    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591952    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591955    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591957    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.818536 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591965    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591968    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591971    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591974    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591977    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591980    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591982    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591985    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591988    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591990    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591994    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591997    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.591999    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592002    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592005    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592008    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592011    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592013    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592016    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592019    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.819720 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592021    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592024    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592026    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592029    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592031    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592034    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592039    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592042    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592044    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592047    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592050    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592052    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592060    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592063    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592068    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592070    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592073    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592075    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592078    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.820791 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592081    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592083    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592087    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592090    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592093    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592095    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592097    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592100    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592103    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592105    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592108    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592111    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592113    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592116    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592118    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592121    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592123    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592126    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.821867 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.592129    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.592931    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.601535    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.601550    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.601570    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.601576    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601635    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601640    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601643    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601646    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601650    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601652    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601655    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601659    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601661    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.822788 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601664    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601667    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601670    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601672    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601675    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601677    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601680    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601683    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601686    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601688    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601691    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601695    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601697    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601700    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601703    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601705    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601708    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601711    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601714    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.823728 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601717    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601720    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601722    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601725    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601728    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601730    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601733    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601735    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601738    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601740    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601743    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601745    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601749    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601753    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601756    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601759    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601762    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601764    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601768    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601771    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.827151 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601773    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601777    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601779    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601782    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601784    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601787    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601790    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601792    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601795    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601798    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601801    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601804    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601807    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601810    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601813    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601816    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601818    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601821    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601824    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601827    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.828028 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601829    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601832    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601834    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601837    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601839    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601842    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601845    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601847    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601850    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601853    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601857    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601861    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601864    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601867    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601870    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601873    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601876    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601878    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601881    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601883    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.835400 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601886    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601889    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601892    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601895    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601898    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601900    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601903    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601905    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601908    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601912    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.601915    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.601920    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602033    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602038    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 11:28:43.836317 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602041    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602044    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602048    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602051    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602053    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602060    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602065    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602068    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602071    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602075    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602079    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602082    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602085    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602087    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602090    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602093    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602095    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602098    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602100    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 11:28:43.836971 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602103    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602106    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602108    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602111    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602114    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602116    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602119    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602121    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602124    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602127    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602129    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602148    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602151    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602154    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602157    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602159    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602162    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602165    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602169    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602172    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 11:28:43.837858 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602175    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602177    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602180    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602184    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602188    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602191    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602193    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602196    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602199    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602202    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602204    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602207    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602209    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602212    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602215    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602217    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602220    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602222    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602225    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602228    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 11:28:43.838749 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602230    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602233    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602235    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602238    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602240    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602243    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602245    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602248    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602251    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602253    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602257    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602260    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602263    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602265    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602268    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602272    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602274    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602278    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602281    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602283    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 11:28:43.839633 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602287    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602290    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602293    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602296    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602298    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602302    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602306    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602311    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602314    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602317    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602320    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602323    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602326    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602328    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602331    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602333    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 11:28:43.840510 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:43.602336    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.602341    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.602450    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.604583    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.606380    2581 server.go:1019] "Starting client certificate rotation"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.606480    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.606511    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.609262    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.610436    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.624589    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.626605    2581 log.go:25] "Validated CRI v1 image API"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.627408    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 11:28:43.841367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.633517    2581 fs.go:135] Filesystem UUIDs: map[38a80288-be95-4619-9d4f-122c9b6b068c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 928b7db7-64cd-4bca-bbe1-ccf161aad664:/dev/nvme0n1p4]
Jul 06 11:28:43.842014 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.633532    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.639351    2581 manager.go:216] Machine: {Timestamp:2026-07-06 11:28:43.637917622 +0000 UTC m=+0.349010143 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097801 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256e6f72b2d52a7cf12a2dc2d81f2b SystemUUID:ec256e6f-72b2-d52a-7cf1-2a2dc2d81f2b BootID:5fcdc19a-e55d-4e1a-9604-4a83fd0a19b3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:ad:b3:e4:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:ad:b3:e4:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:e3:ba:20:b3:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.639449    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.639553    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.642738    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.642765    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.643668    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.643681    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 11:28:43.842433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.643690    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.644465    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.645762    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.648762    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.648903    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.649784    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.649799    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.649818    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.649831    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.649841    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.650291    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.650323    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.657327    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.659199    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.659227    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660462    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660479    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660487    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660493    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660502    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660507    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660516    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660521    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660527    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660533    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660541    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.660546    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.661240    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.662189    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.662200    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.665419    2581 server.go:1268] "Started kubelet"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.665614    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.665701    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.666248    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.667742    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.668013    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.668035    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.668169    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.668571    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 11:28:43.842868 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.674637    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.674641    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.674781    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.675389    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.675404    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.674489    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-178.ec2.internal.18bfafd8ebc5768b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-178.ec2.internal,UID:ip-10-0-138-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-178.ec2.internal,},FirstTimestamp:2026-07-06 11:28:43.665389195 +0000 UTC m=+0.376481717,LastTimestamp:2026-07-06 11:28:43.665389195 +0000 UTC m=+0.376481717,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-178.ec2.internal,}"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.675595    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.675612    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.675623    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.682159    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.683016    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.683113    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.705282    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2jjp"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.705324    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2jjp"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.705803    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706006    2581 factory.go:153] Registering CRI-O factory
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706019    2581 factory.go:223] Registration of the crio container factory successfully
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706059    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706064    2581 factory.go:55] Registering systemd factory
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706070    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706091    2581 factory.go:103] Registering Raw factory
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706102    2581 manager.go:1196] Started watching for new ooms in manager
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.706647    2581 manager.go:349] Starting recovery of all containers
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.717187    2581 manager.go:354] Recovery completed
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.721164    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723243    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723261    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723271    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723758    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723765    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.723778    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.724627    2581 policy_none.go:49] "None policy: Start"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.724640    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 11:28:43.844590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.724651    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.725424    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.725512    2581 policy_none.go:47] "Start"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.725561    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-178.ec2.internal.18bfafd8ef38655d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-178.ec2.internal,UID:ip-10-0-138-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-178.ec2.internal,},FirstTimestamp:2026-07-06 11:28:43.723253085 +0000 UTC m=+0.434345606,LastTimestamp:2026-07-06 11:28:43.723253085 +0000 UTC m=+0.434345606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-178.ec2.internal,}"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.726125    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.726169    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.726183    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.772708    2581 manager.go:337] "Starting Device Plugin manager"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.772845    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.772858    2581 server.go:87] "Starting device plugin registration server"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.773123    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.773152    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.773232    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.773314    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.773326    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.773960    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.774025    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.820268    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.820297    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.820315    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.820343    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 11:28:43.846107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.823305    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.873759    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.874594    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.874619    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.874629    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.874652    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.883757    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.883774    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-178.ec2.internal\": node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.907623    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.920666    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"]
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.920718    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.921453    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.921479    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.921493    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.922642    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.922767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.922800    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923414    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923432    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923447    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923653    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923665    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.923673    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.924638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.924656    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.925221    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.925237    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.925246    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeHasSufficientPID"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.945827    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-178.ec2.internal\" not found" node="ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:43.950482    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-178.ec2.internal\" not found" node="ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.006105 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.976957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.008703 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.976977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.008703 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:43.976994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e91ce37bfe25d5bab02452089d06221-config\") pod \"kube-apiserver-proxy-ip-10-0-138-178.ec2.internal\" (UID: \"6e91ce37bfe25d5bab02452089d06221\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.008703 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.008502    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e91ce37bfe25d5bab02452089d06221-config\") pod \"kube-apiserver-proxy-ip-10-0-138-178.ec2.internal\" (UID: \"6e91ce37bfe25d5bab02452089d06221\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077502    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6e91ce37bfe25d5bab02452089d06221-config\") pod \"kube-apiserver-proxy-ip-10-0-138-178.ec2.internal\" (UID: \"6e91ce37bfe25d5bab02452089d06221\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077530    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.077548    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68ee07df143f57ebb3e511d9c1fc7bb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal\" (UID: \"68ee07df143f57ebb3e511d9c1fc7bb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.109744    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.233749 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.210832    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.436063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.251007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.436063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.253528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.436063 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.312872    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.436063 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.412943    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.513856    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.546530    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.606123    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.606280    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.606292    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 11:28:44.656158 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:44.614840    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-178.ec2.internal\" not found"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.690973    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.712194    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 11:23:44 +0000 UTC" deadline="2028-03-07 17:01:20.663632226 +0000 UTC"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.712271    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14645h32m35.951364517s"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.775224    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.787533    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.789471    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.798765    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 11:28:44.846695 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.842317    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:45.040250 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:44.862389    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e91ce37bfe25d5bab02452089d06221.slice/crio-029d2e530eed363deec7bd83cfd965cc5c1bc2827cb8636de12dc48d26c62a63 WatchSource:0}: Error finding container 029d2e530eed363deec7bd83cfd965cc5c1bc2827cb8636de12dc48d26c62a63: Status 404 returned error can't find the container with id 029d2e530eed363deec7bd83cfd965cc5c1bc2827cb8636de12dc48d26c62a63
Jul 06 11:28:45.040250 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:44.862680    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ee07df143f57ebb3e511d9c1fc7bb5.slice/crio-911254196d4373ecdc7de1c01b3aa0fc012875dc255f80c256ec7b570e487779 WatchSource:0}: Error finding container 911254196d4373ecdc7de1c01b3aa0fc012875dc255f80c256ec7b570e487779: Status 404 returned error can't find the container with id 911254196d4373ecdc7de1c01b3aa0fc012875dc255f80c256ec7b570e487779
Jul 06 11:28:45.040250 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:44.868730    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.653808    2581 apiserver.go:52] "Watching apiserver"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.660663    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.661187    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-vmbl7","openshift-multus/multus-jsqlb","kube-system/global-pull-secret-syncer-qzr6n","kube-system/konnectivity-agent-kdjsz","openshift-dns/node-resolver-fskrh","openshift-multus/network-metrics-daemon-v489s","openshift-network-diagnostics/network-check-target-fq2w2","openshift-network-operator/iptables-alerter-pcvnm","openshift-ovn-kubernetes/ovnkube-node-vg4jb","kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg","openshift-cluster-node-tuning-operator/tuned-chh2c","openshift-image-registry/node-ca-4pjf4"]
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.663116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.663237    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.664574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.666048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.667013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.667377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7kl2r\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.668482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tc98b\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668606    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.668898    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.669660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.670768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.671881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.672759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.672787    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.673217    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.673983    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zs6xs\""
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.674570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.702925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.675475    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-srk5b\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.675478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.677035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.677242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbxtx\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.677512    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.677716    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.677962    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.678397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.679377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b4smc\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.679425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.679637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.680077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.683486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.683522    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.683544    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.683713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h6jzn\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684082    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684087    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684554    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7gg98\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.684753    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.685190    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.685214    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.685687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-k8s-cni-cncf-io\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.704567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-bin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-kubelet\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-multus-certs\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-dbus\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687548    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-host\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-cnibin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7fx\" (UniqueName: \"kubernetes.io/projected/06427b2e-02c1-4ee1-a201-53538c2891f2-kube-api-access-2n7fx\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687608    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-var-lib-kubelet\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x86h5\" (UniqueName: \"kubernetes.io/projected/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-kube-api-access-x86h5\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-cnibin\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-conf\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5159d19a-7f5e-44c1-b602-99f67c1370cf-agent-certs\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-netns\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.712972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a443af82-1b06-45a9-93cd-13f87a30384e-hosts-file\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gdhj\" (UniqueName: \"kubernetes.io/projected/9cab5652-c268-4874-82e3-85b7dfed1ff2-kube-api-access-5gdhj\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-serviceca\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-socket-dir-parent\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhnn\" (UniqueName: \"kubernetes.io/projected/1b8cc610-7b55-4285-82c7-f48dfaf7e110-kube-api-access-7rhnn\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.687999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-lib-modules\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-multus\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-etc-kubernetes\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a443af82-1b06-45a9-93cd-13f87a30384e-tmp-dir\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 11:28:45.715036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j8v4v\""
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv7dx\" (UniqueName: \"kubernetes.io/projected/a443af82-1b06-45a9-93cd-13f87a30384e-kube-api-access-jv7dx\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-sys\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-tuned\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-systemd\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-tmp\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-modprobe-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-daemon-config\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-kubelet-config\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b8cc610-7b55-4285-82c7-f48dfaf7e110-host-slash\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-cni-binary-copy\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688502    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v59dt\" (UniqueName: \"kubernetes.io/projected/acc3219a-f3b6-4711-82d3-73c72b3fe824-kube-api-access-v59dt\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.715977 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-os-release\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-conf-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5159d19a-7f5e-44c1-b602-99f67c1370cf-konnectivity-ca\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-system-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-os-release\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-hostroot\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlx8s\" (UniqueName: \"kubernetes.io/projected/e81213a7-0dcf-4d59-93f2-34481ca0422a-kube-api-access-dlx8s\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysconfig\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-run\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-host\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.688975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b8cc610-7b55-4285-82c7-f48dfaf7e110-iptables-alerter-script\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.689008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.717582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.689031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-kubernetes\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.719714 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.696316    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 11:28:45.722546 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.721789    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2rb7v"
Jul 06 11:28:45.731864 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.731440    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2rb7v"
Jul 06 11:28:45.777465 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.776544    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 11:28:45.789781 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-etc-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.789897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-config\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.789897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-kubelet\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.789897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-multus-certs\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.789897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-dbus\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-host\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-cnibin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.789985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7fx\" (UniqueName: \"kubernetes.io/projected/06427b2e-02c1-4ee1-a201-53538c2891f2-kube-api-access-2n7fx\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-var-lib-kubelet\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-var-lib-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.790109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x86h5\" (UniqueName: \"kubernetes.io/projected/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-kube-api-access-x86h5\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-cnibin\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-conf\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5159d19a-7f5e-44c1-b602-99f67c1370cf-agent-certs\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-netns\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a443af82-1b06-45a9-93cd-13f87a30384e-hosts-file\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gdhj\" (UniqueName: \"kubernetes.io/projected/9cab5652-c268-4874-82e3-85b7dfed1ff2-kube-api-access-5gdhj\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-log-socket\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-netd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-serviceca\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790374    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-var-lib-kubelet\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790452    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-kubelet\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.790573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-multus-certs\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-conf\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790651    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-cnibin\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790663    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790673    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-cnibin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-dbus\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-host\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a443af82-1b06-45a9-93cd-13f87a30384e-hosts-file\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.790787    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-netns\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.791203 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-socket-dir-parent\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.791765 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-socket-dir-parent\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.791765 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-serviceca\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.791853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhnn\" (UniqueName: \"kubernetes.io/projected/1b8cc610-7b55-4285-82c7-f48dfaf7e110-kube-api-access-7rhnn\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.791853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.791951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.791951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-slash\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.791951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.791951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.791951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-device-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.791993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-lib-modules\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-multus\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-etc-kubernetes\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a443af82-1b06-45a9-93cd-13f87a30384e-tmp-dir\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv7dx\" (UniqueName: \"kubernetes.io/projected/a443af82-1b06-45a9-93cd-13f87a30384e-kube-api-access-jv7dx\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-sys\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-tuned\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-systemd\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-tmp\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-node-log\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.792336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-modprobe-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-ovn\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-registration-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zdlg\" (UniqueName: \"kubernetes.io/projected/b48933f8-6743-4aee-827f-a34cf8f590d4-kube-api-access-5zdlg\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-daemon-config\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-kubelet-config\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b8cc610-7b55-4285-82c7-f48dfaf7e110-host-slash\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-env-overrides\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-script-lib\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-sys-fs\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792547    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-cni-binary-copy\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793062 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v59dt\" (UniqueName: \"kubernetes.io/projected/acc3219a-f3b6-4711-82d3-73c72b3fe824-kube-api-access-v59dt\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-os-release\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-kubelet\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792631    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-systemd\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-socket-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-conf-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5159d19a-7f5e-44c1-b602-99f67c1370cf-konnectivity-ca\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbx9\" (UniqueName: \"kubernetes.io/projected/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-kube-api-access-jrbx9\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-system-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-os-release\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-hostroot\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlx8s\" (UniqueName: \"kubernetes.io/projected/e81213a7-0dcf-4d59-93f2-34481ca0422a-kube-api-access-dlx8s\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.793775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysconfig\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-run\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-systemd-units\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.792973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-host\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b8cc610-7b55-4285-82c7-f48dfaf7e110-iptables-alerter-script\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-kubernetes\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-systemd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-bin\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793112    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.793259    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.793339    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:46.29331525 +0000 UTC m=+3.004407786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793599    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-lib-modules\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793671    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.794459 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793723    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-multus\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.795159 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.793769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-etc-kubernetes\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.795159 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.794092    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a443af82-1b06-45a9-93cd-13f87a30384e-tmp-dir\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.795159 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.794727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.795159 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.794794    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-sys\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.795159 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.795151    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-conf-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.795291    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-modprobe-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.795855    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-multus-daemon-config\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.795928    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3db4e29d-85fe-42e9-b0c1-41bb0943d974-kubelet-config\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.795976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1b8cc610-7b55-4285-82c7-f48dfaf7e110-host-slash\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.796020    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5159d19a-7f5e-44c1-b602-99f67c1370cf-agent-certs\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.796341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-tmp\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.796732 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.796350    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysconfig\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.797348    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-run\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.797443    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-host\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.797681    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06427b2e-02c1-4ee1-a201-53538c2891f2-cni-binary-copy\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.797975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1b8cc610-7b55-4285-82c7-f48dfaf7e110-iptables-alerter-script\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798235    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5159d19a-7f5e-44c1-b602-99f67c1370cf-konnectivity-ca\") pod \"konnectivity-agent-kdjsz\" (UID: \"5159d19a-7f5e-44c1-b602-99f67c1370cf\") " pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.796413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-system-cni-dir\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798430    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-tuned\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798482    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81213a7-0dcf-4d59-93f2-34481ca0422a-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798595    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-kubernetes\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-k8s-cni-cncf-io\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-bin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-netns\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.799309 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798915    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-run-k8s-cni-cncf-io\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.798963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-host-var-lib-cni-bin\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.799020    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81213a7-0dcf-4d59-93f2-34481ca0422a-os-release\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.799051    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9cab5652-c268-4874-82e3-85b7dfed1ff2-etc-sysctl-d\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.799123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-system-cni-dir\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.799172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-hostroot\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.799252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06427b2e-02c1-4ee1-a201-53538c2891f2-os-release\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.799329    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:45.801341 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.799388    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:46.299369199 +0000 UTC m=+3.010461725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:45.807347 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.807234    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhnn\" (UniqueName: \"kubernetes.io/projected/1b8cc610-7b55-4285-82c7-f48dfaf7e110-kube-api-access-7rhnn\") pod \"iptables-alerter-pcvnm\" (UID: \"1b8cc610-7b55-4285-82c7-f48dfaf7e110\") " pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:45.807452 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.807421    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gdhj\" (UniqueName: \"kubernetes.io/projected/9cab5652-c268-4874-82e3-85b7dfed1ff2-kube-api-access-5gdhj\") pod \"tuned-chh2c\" (UID: \"9cab5652-c268-4874-82e3-85b7dfed1ff2\") " pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.808956 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.808925    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7fx\" (UniqueName: \"kubernetes.io/projected/06427b2e-02c1-4ee1-a201-53538c2891f2-kube-api-access-2n7fx\") pod \"multus-jsqlb\" (UID: \"06427b2e-02c1-4ee1-a201-53538c2891f2\") " pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.809333 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.809142    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x86h5\" (UniqueName: \"kubernetes.io/projected/d2d8b0c8-c11a-4c74-a235-c128d84e70e2-kube-api-access-x86h5\") pod \"node-ca-4pjf4\" (UID: \"d2d8b0c8-c11a-4c74-a235-c128d84e70e2\") " pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:45.809988 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.809811    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv7dx\" (UniqueName: \"kubernetes.io/projected/a443af82-1b06-45a9-93cd-13f87a30384e-kube-api-access-jv7dx\") pod \"node-resolver-fskrh\" (UID: \"a443af82-1b06-45a9-93cd-13f87a30384e\") " pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:45.810357 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.810303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v59dt\" (UniqueName: \"kubernetes.io/projected/acc3219a-f3b6-4711-82d3-73c72b3fe824-kube-api-access-v59dt\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:45.810976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.810928    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlx8s\" (UniqueName: \"kubernetes.io/projected/e81213a7-0dcf-4d59-93f2-34481ca0422a-kube-api-access-dlx8s\") pod \"multus-additional-cni-plugins-vmbl7\" (UID: \"e81213a7-0dcf-4d59-93f2-34481ca0422a\") " pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.826466 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.826367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal" event={"ID":"6e91ce37bfe25d5bab02452089d06221","Type":"ContainerStarted","Data":"029d2e530eed363deec7bd83cfd965cc5c1bc2827cb8636de12dc48d26c62a63"}
Jul 06 11:28:45.828404 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.828360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmbl7"
Jul 06 11:28:45.829043 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.828997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal" event={"ID":"68ee07df143f57ebb3e511d9c1fc7bb5","Type":"ContainerStarted","Data":"911254196d4373ecdc7de1c01b3aa0fc012875dc255f80c256ec7b570e487779"}
Jul 06 11:28:45.882532 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.882507    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-env-overrides\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-script-lib\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-sys-fs\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-kubelet\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-socket-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbx9\" (UniqueName: \"kubernetes.io/projected/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-kube-api-access-jrbx9\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-systemd-units\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-sys-fs\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-socket-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.899849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.899811    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-systemd-units\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900121    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-script-lib\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900182    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-env-overrides\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-systemd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-bin\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-netns\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-etc-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-config\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-var-lib-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.900513 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-log-socket\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-netd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-slash\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-device-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-node-log\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-ovn\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-registration-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.901053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.900942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zdlg\" (UniqueName: \"kubernetes.io/projected/b48933f8-6743-4aee-827f-a34cf8f590d4-kube-api-access-5zdlg\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.901701 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.901639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-systemd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901701 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.901684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-bin\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.901806 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.901735    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.901806 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.901776    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-netns\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902056 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-slash\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902174 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-etc-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902174 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902079    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902446    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-device-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902544    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-registration-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902574    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovnkube-config\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-cni-netd\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-host-kubelet\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902579    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-node-log\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-run-ovn\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-log-socket\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b48933f8-6743-4aee-827f-a34cf8f590d4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.902990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.902806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-var-lib-openvswitch\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.906181 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.906136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-ovn-node-metrics-cert\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.906763 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.906481    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:28:45.906763 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.906513    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:28:45.906763 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.906529    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:45.906763 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:45.906590    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:28:46.406573326 +0000 UTC m=+3.117665838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:45.914823 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.914790    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zdlg\" (UniqueName: \"kubernetes.io/projected/b48933f8-6743-4aee-827f-a34cf8f590d4-kube-api-access-5zdlg\") pod \"aws-ebs-csi-driver-node-g9jjg\" (UID: \"b48933f8-6743-4aee-827f-a34cf8f590d4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:45.917461 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.917399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbx9\" (UniqueName: \"kubernetes.io/projected/a74f345f-87ae-4290-8ccd-2ddc378e7e9f-kube-api-access-jrbx9\") pod \"ovnkube-node-vg4jb\" (UID: \"a74f345f-87ae-4290-8ccd-2ddc378e7e9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:45.979716 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.979622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-chh2c"
Jul 06 11:28:45.989209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.989173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jsqlb"
Jul 06 11:28:45.989593 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:45.989560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab5652_c268_4874_82e3_85b7dfed1ff2.slice/crio-591f67b55896a403806c4268ad6f082b58601386be14a5cfc8dd71ce41638c57 WatchSource:0}: Error finding container 591f67b55896a403806c4268ad6f082b58601386be14a5cfc8dd71ce41638c57: Status 404 returned error can't find the container with id 591f67b55896a403806c4268ad6f082b58601386be14a5cfc8dd71ce41638c57
Jul 06 11:28:45.998972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:45.998925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:46.000425 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:46.000394    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06427b2e_02c1_4ee1_a201_53538c2891f2.slice/crio-1a0ceec40dbaf78d9433f1ef9cff1fba53f320bc3e5a25d87ea0bb5484d026e2 WatchSource:0}: Error finding container 1a0ceec40dbaf78d9433f1ef9cff1fba53f320bc3e5a25d87ea0bb5484d026e2: Status 404 returned error can't find the container with id 1a0ceec40dbaf78d9433f1ef9cff1fba53f320bc3e5a25d87ea0bb5484d026e2
Jul 06 11:28:46.006479 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.006449    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fskrh"
Jul 06 11:28:46.010644 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:46.010608    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5159d19a_7f5e_44c1_b602_99f67c1370cf.slice/crio-9b278caac0947336688af1d77a723e7fc1f0fc48b2f06443e08e8c8d1fb7416f WatchSource:0}: Error finding container 9b278caac0947336688af1d77a723e7fc1f0fc48b2f06443e08e8c8d1fb7416f: Status 404 returned error can't find the container with id 9b278caac0947336688af1d77a723e7fc1f0fc48b2f06443e08e8c8d1fb7416f
Jul 06 11:28:46.016983 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:46.016957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda443af82_1b06_45a9_93cd_13f87a30384e.slice/crio-0e71d8f511f1aad751bf45befbb40c66615625c2f644a5a993d9e3abfb6befb6 WatchSource:0}: Error finding container 0e71d8f511f1aad751bf45befbb40c66615625c2f644a5a993d9e3abfb6befb6: Status 404 returned error can't find the container with id 0e71d8f511f1aad751bf45befbb40c66615625c2f644a5a993d9e3abfb6befb6
Jul 06 11:28:46.082424 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.082393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pcvnm"
Jul 06 11:28:46.090353 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.090326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pjf4"
Jul 06 11:28:46.093648 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:46.093476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8cc610_7b55_4285_82c7_f48dfaf7e110.slice/crio-53c1c2a350d6ea315fdd0470a86fdc1876de6dfbe1683d7031ff9fd90c3e8977 WatchSource:0}: Error finding container 53c1c2a350d6ea315fdd0470a86fdc1876de6dfbe1683d7031ff9fd90c3e8977: Status 404 returned error can't find the container with id 53c1c2a350d6ea315fdd0470a86fdc1876de6dfbe1683d7031ff9fd90c3e8977
Jul 06 11:28:46.099682 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:28:46.099660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d8b0c8_c11a_4c74_a235_c128d84e70e2.slice/crio-1b6803bc94aecb1a82757620d3797e71cbeca98ed4f49528d64c11f08dffd476 WatchSource:0}: Error finding container 1b6803bc94aecb1a82757620d3797e71cbeca98ed4f49528d64c11f08dffd476: Status 404 returned error can't find the container with id 1b6803bc94aecb1a82757620d3797e71cbeca98ed4f49528d64c11f08dffd476
Jul 06 11:28:46.136916 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.136889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:28:46.144360 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.144335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg"
Jul 06 11:28:46.303531 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.303489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:46.303721 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.303562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:46.303721 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.303647    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:46.303834 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.303721    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:46.303834 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.303733    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:47.303708086 +0000 UTC m=+4.014800610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:46.303834 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.303782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:47.303764203 +0000 UTC m=+4.014856718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:46.505177 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.505125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:46.505364 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.505344    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:28:46.505410 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.505374    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:28:46.505410 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.505390    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:46.505505 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.505457    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:28:47.505438115 +0000 UTC m=+4.216530646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:46.641313 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.641160    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 11:28:46.736244 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.734459    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:23:46 +0000 UTC" deadline="2027-12-05 21:06:58.644943825 +0000 UTC"
Jul 06 11:28:46.736244 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.734512    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12417h38m11.910438712s"
Jul 06 11:28:46.821006 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.820972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:46.821197 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.821110    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:46.821584 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.821564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:46.821701 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:46.821679    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:46.839997 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.839837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pjf4" event={"ID":"d2d8b0c8-c11a-4c74-a235-c128d84e70e2","Type":"ContainerStarted","Data":"1b6803bc94aecb1a82757620d3797e71cbeca98ed4f49528d64c11f08dffd476"}
Jul 06 11:28:46.842569 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.842539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pcvnm" event={"ID":"1b8cc610-7b55-4285-82c7-f48dfaf7e110","Type":"ContainerStarted","Data":"53c1c2a350d6ea315fdd0470a86fdc1876de6dfbe1683d7031ff9fd90c3e8977"}
Jul 06 11:28:46.844089 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.844022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fskrh" event={"ID":"a443af82-1b06-45a9-93cd-13f87a30384e","Type":"ContainerStarted","Data":"0e71d8f511f1aad751bf45befbb40c66615625c2f644a5a993d9e3abfb6befb6"}
Jul 06 11:28:46.846196 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.846128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jsqlb" event={"ID":"06427b2e-02c1-4ee1-a201-53538c2891f2","Type":"ContainerStarted","Data":"1a0ceec40dbaf78d9433f1ef9cff1fba53f320bc3e5a25d87ea0bb5484d026e2"}
Jul 06 11:28:46.847787 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.847731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-chh2c" event={"ID":"9cab5652-c268-4874-82e3-85b7dfed1ff2","Type":"ContainerStarted","Data":"591f67b55896a403806c4268ad6f082b58601386be14a5cfc8dd71ce41638c57"}
Jul 06 11:28:46.851312 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.851250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerStarted","Data":"359f8d3ffa1e1def4b8c52e2f1b2090c05acd43f974dc0bf350f49416a98f43e"}
Jul 06 11:28:46.853687 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:46.853627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdjsz" event={"ID":"5159d19a-7f5e-44c1-b602-99f67c1370cf","Type":"ContainerStarted","Data":"9b278caac0947336688af1d77a723e7fc1f0fc48b2f06443e08e8c8d1fb7416f"}
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.313093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.313207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.313453    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.313527    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:49.313504493 +0000 UTC m=+6.024597029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.313970    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:47.314065 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.314029    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:49.314011307 +0000 UTC m=+6.025103819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:47.515153 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.515112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:47.515350 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.515308    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:28:47.515350 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.515334    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:28:47.515350 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.515348    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:47.515522 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.515415    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:28:49.515395877 +0000 UTC m=+6.226488409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:47.735829 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.735654    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:23:46 +0000 UTC" deadline="2027-12-04 02:14:46.345864666 +0000 UTC"
Jul 06 11:28:47.735829 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.735721    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12374h45m58.610148519s"
Jul 06 11:28:47.823412 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.823381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:47.823603 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:47.823519    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:47.868395 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.868358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg" event={"ID":"b48933f8-6743-4aee-827f-a34cf8f590d4","Type":"ContainerStarted","Data":"7881335ac574bf89442b064be51736f420abb24208b95146980c6eb4f85a11f8"}
Jul 06 11:28:47.871620 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:47.871587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"4d80b332599986c135fe96ddd7abdb783e817ce244a379a6fbdd83b99eb09932"}
Jul 06 11:28:48.821319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:48.820511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:48.821319 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:48.820653    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:48.821319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:48.820801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:48.821319 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:48.820881    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:48.889674 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:48.889611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal" event={"ID":"6e91ce37bfe25d5bab02452089d06221","Type":"ContainerStarted","Data":"222361dd7735344a7e9cc219f73a2d78d1ca27cb5d857901472dac3c5037b926"}
Jul 06 11:28:48.906565 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:48.906503    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-178.ec2.internal" podStartSLOduration=3.906480346 podStartE2EDuration="3.906480346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:28:48.906480265 +0000 UTC m=+5.617572799" watchObservedRunningTime="2026-07-06 11:28:48.906480346 +0000 UTC m=+5.617572880"
Jul 06 11:28:49.329549 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.329508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:49.329708 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.329585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:49.329786 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.329721    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:49.329836 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.329791    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:53.329769814 +0000 UTC m=+10.040862347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:49.330294 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.330204    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:49.330294 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.330274    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:28:53.330259058 +0000 UTC m=+10.041351573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:49.531604 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.531562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:49.539232 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.535447    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:28:49.539232 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.535479    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:28:49.539232 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.535501    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:49.539232 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.535575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:28:53.535547806 +0000 UTC m=+10.246640338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:49.824016 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.823425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:49.824016 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:49.823586    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:49.901636 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.901599    2581 generic.go:356] "Generic (PLEG): container finished" podID="68ee07df143f57ebb3e511d9c1fc7bb5" containerID="9624c7a633a61b927461758e8621c9b10ad6f5327e19aec101bd4cf6557bc329" exitCode=0
Jul 06 11:28:49.902339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.902254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal" event={"ID":"68ee07df143f57ebb3e511d9c1fc7bb5","Type":"ContainerDied","Data":"9624c7a633a61b927461758e8621c9b10ad6f5327e19aec101bd4cf6557bc329"}
Jul 06 11:28:49.910846 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:49.910823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdjsz" event={"ID":"5159d19a-7f5e-44c1-b602-99f67c1370cf","Type":"ContainerStarted","Data":"bdc3e4f04231f9743ee22344a352feffa3b6afc371fce303d9c47e9462ca2586"}
Jul 06 11:28:50.821272 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:50.820556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:50.821272 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:50.820703    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:50.821272 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:50.821108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:50.821272 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:50.821227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:51.821064 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:51.820846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:51.821064 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:51.820959    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:52.820550 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:52.820520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:52.820550 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:52.820544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:52.820771 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:52.820663    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:52.820835 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:52.820784    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:53.365222 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:53.365186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:53.365699 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:53.365263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:53.365699 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.365349    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:53.365699 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.365435    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:01.365414838 +0000 UTC m=+18.076507353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:28:53.365699 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.365360    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:53.365699 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.365517    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:01.365501879 +0000 UTC m=+18.076594404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:28:53.570698 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:53.570651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:53.570965 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.570944    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:28:53.571091 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.570977    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:28:53.571091 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.570991    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:53.571091 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.571076    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:29:01.571040378 +0000 UTC m=+18.282132922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:28:53.821590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:53.821550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:53.821758 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:53.821658    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:54.822045 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:54.821470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:54.822045 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:54.821615    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:54.822045 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:54.821937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:54.822045 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:54.822022    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:54.865391 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:54.865175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:54.866322 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:54.866162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:54.881338 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:54.881268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdjsz" podStartSLOduration=8.264171206 podStartE2EDuration="10.881249618s" totalImagesPullingTime="2.617078412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:28:49.938669739 +0000 UTC m=+6.649762273" watchObservedRunningTime="2026-07-06 11:28:54.881249618 +0000 UTC m=+11.592342149"
Jul 06 11:28:55.821291 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:55.820800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:55.821480 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:55.821409    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:56.820933 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:56.820905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:56.821283 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:56.820906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:56.821283 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:56.821005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:56.821283 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:56.821129    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:57.641392 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:57.641353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:28:57.741833 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:57.741750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:28:57.821218 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:57.821185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:57.821669 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:57.821309    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:28:58.409186 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.409153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:58.409359 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.409292    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 11:28:58.410254 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.410011    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdjsz"
Jul 06 11:28:58.487643 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.487567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:28:58.820711 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.820674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:28:58.820877 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:58.820688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:28:58.820877 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:58.820821    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:28:58.820980 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:58.820877    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:28:59.821512 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:28:59.821478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:28:59.821906 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:28:59.821611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:00.820777 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:00.820741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:00.820777 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:00.820769    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:00.821028 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:00.820858    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:00.821028 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:00.820992    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:01.427854 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:01.427807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:01.428303 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:01.427892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:01.428303 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.427977    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:29:01.428303 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.428035    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:29:01.428303 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.428043    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:17.428029006 +0000 UTC m=+34.139121514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:29:01.428303 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.428081    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:17.428068003 +0000 UTC m=+34.139160512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:29:01.629480 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:01.629397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:01.629636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.629523    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:29:01.629636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.629545    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:29:01.629636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.629558    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:29:01.629636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.629610    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:29:17.62959433 +0000 UTC m=+34.340686855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:29:01.821428 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:01.821386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:01.821622 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:01.821514    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:01.940337 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:01.940253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:02.042501 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:02.042464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:02.821243 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:02.821207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:02.821655 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:02.821207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:02.821655 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:02.821322    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:02.821655 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:02.821404    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:03.384290 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:03.384254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:03.448441 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:03.448405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:03.822180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:03.822147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:03.822639 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:03.822269    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:04.821046 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:04.821012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:04.821226 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:04.821056    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:04.821226 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:04.821155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:04.821358 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:04.821275    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:05.822641 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.822404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:05.822934 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:05.822812    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:05.942772 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.942695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pjf4" event={"ID":"d2d8b0c8-c11a-4c74-a235-c128d84e70e2","Type":"ContainerStarted","Data":"0b8c2baecc09925444b029ce68492b7e65e1852c6255f32a35093aca6d9b0276"}
Jul 06 11:29:05.943917 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.943893    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fskrh" event={"ID":"a443af82-1b06-45a9-93cd-13f87a30384e","Type":"ContainerStarted","Data":"9101187e6109fded13ce043064082960b407a151dcf9b98c5acf898a5f9cb392"}
Jul 06 11:29:05.945314 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.945284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jsqlb" event={"ID":"06427b2e-02c1-4ee1-a201-53538c2891f2","Type":"ContainerStarted","Data":"ed5c56c931db757a4ff1866a09423e98ba75a39636fab259905c7ef4ec09fe58"}
Jul 06 11:29:05.946858 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.946833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-chh2c" event={"ID":"9cab5652-c268-4874-82e3-85b7dfed1ff2","Type":"ContainerStarted","Data":"802e9efd48862852b9f5d7faf1827e376503f4dc6af9bbbe426f01bca19bfdf3"}
Jul 06 11:29:05.948236 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.948215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerStarted","Data":"b3c68a3836fd38697f190dbfc1099835ccaa3ae2c57280d4cd766e3b99ba0fb0"}
Jul 06 11:29:05.949673 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.949612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg" event={"ID":"b48933f8-6743-4aee-827f-a34cf8f590d4","Type":"ContainerStarted","Data":"7ad44742811f111e167979d1723b2ed5ffb92969c5d0f6ee76b6a9d4308edf9d"}
Jul 06 11:29:05.951412 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.951391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal" event={"ID":"68ee07df143f57ebb3e511d9c1fc7bb5","Type":"ContainerStarted","Data":"3f5ec6ac23df6fe2b828f7b2943f8ef2160a5d5a760ac3f2f3244397a086a827"}
Jul 06 11:29:05.961094 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:05.961048    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4pjf4" podStartSLOduration=2.4275095 podStartE2EDuration="21.961022978s" totalImagesPullingTime="19.533513478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:05.960407939 +0000 UTC m=+22.671500468" watchObservedRunningTime="2026-07-06 11:29:05.961022978 +0000 UTC m=+22.672115509"
Jul 06 11:29:06.000802 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.000749    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fskrh" podStartSLOduration=2.385379421 podStartE2EDuration="22.000733069s" totalImagesPullingTime="19.615353648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:06.000445511 +0000 UTC m=+22.711538062" watchObservedRunningTime="2026-07-06 11:29:06.000733069 +0000 UTC m=+22.711825598"
Jul 06 11:29:06.020667 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.020625    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-178.ec2.internal" podStartSLOduration=21.020609919 podStartE2EDuration="21.020609919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:06.020379891 +0000 UTC m=+22.731472422" watchObservedRunningTime="2026-07-06 11:29:06.020609919 +0000 UTC m=+22.731702449"
Jul 06 11:29:06.045032 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.044991    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-chh2c" podStartSLOduration=2.402954157 podStartE2EDuration="22.044975576s" totalImagesPullingTime="19.642021419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:06.04088967 +0000 UTC m=+22.751982201" watchObservedRunningTime="2026-07-06 11:29:06.044975576 +0000 UTC m=+22.756068136"
Jul 06 11:29:06.059682 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.059642    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jsqlb" podStartSLOduration=2.39466462 podStartE2EDuration="22.059626187s" totalImagesPullingTime="19.664961567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:06.059563776 +0000 UTC m=+22.770656307" watchObservedRunningTime="2026-07-06 11:29:06.059626187 +0000 UTC m=+22.770718731"
Jul 06 11:29:06.181937 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.181902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:06.282571 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.282408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:06.383395 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.383368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:06.821488 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.821440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:06.821488 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.821491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:06.821701 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:06.821571    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:06.821749 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:06.821694    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:06.954827 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.954795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pcvnm" event={"ID":"1b8cc610-7b55-4285-82c7-f48dfaf7e110","Type":"ContainerStarted","Data":"282d8a47033ecbee7b029f96c9a1e1943bdb8d657148edc2df06a81dbe7658c1"}
Jul 06 11:29:06.956197 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.956174    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="b3c68a3836fd38697f190dbfc1099835ccaa3ae2c57280d4cd766e3b99ba0fb0" exitCode=0
Jul 06 11:29:06.956268 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.956232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"b3c68a3836fd38697f190dbfc1099835ccaa3ae2c57280d4cd766e3b99ba0fb0"}
Jul 06 11:29:06.959003 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.958987    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:29:06.959291 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959272    2581 generic.go:356] "Generic (PLEG): container finished" podID="a74f345f-87ae-4290-8ccd-2ddc378e7e9f" containerID="44f8d94745f124c75bbe472b9c086943b481bc7d13333f8f5a0f5f44a776f116" exitCode=1
Jul 06 11:29:06.959373 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959355    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"bcf24b415c77a22518ed5761cb95b653e935158a78997aebdc53c5fe37e2a68b"}
Jul 06 11:29:06.959450 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"292918a81842d128239eecba09af3b4ba4ba9debc347a4c3a4261118e20d8267"}
Jul 06 11:29:06.959503 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"9fda99524d265bbac6103104cfb7a8ef5974b0d7df71d31c5e7e27d74f9ae617"}
Jul 06 11:29:06.959556 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"4cf3b4a809921aeae1850d52db138f1ff470ee7175d80b60608ff5db7e3ac683"}
Jul 06 11:29:06.959617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerDied","Data":"44f8d94745f124c75bbe472b9c086943b481bc7d13333f8f5a0f5f44a776f116"}
Jul 06 11:29:06.959673 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.959651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"f7835552ba9f7d1e37087c9066d62e891cc4e2a34ad61fb3b45a016c6878e88b"}
Jul 06 11:29:06.970717 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:06.970678    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pcvnm" podStartSLOduration=3.4324426040000002 podStartE2EDuration="22.970665664s" totalImagesPullingTime="19.53822306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:06.970468036 +0000 UTC m=+23.681560560" watchObservedRunningTime="2026-07-06 11:29:06.970665664 +0000 UTC m=+23.681758191"
Jul 06 11:29:07.090722 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.090657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:07.310642 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.310618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:07.416440 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.416420    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 11:29:07.786129 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.785998    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T11:29:07.416435232Z","UUID":"d7f60616-07a5-4322-882b-15839a71ba2f","Handler":null,"Name":"","Endpoint":""}
Jul 06 11:29:07.787310 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.787290    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 11:29:07.787449 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.787328    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 11:29:07.821334 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.821311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:07.821458 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:07.821399    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:07.964464 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:07.964427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg" event={"ID":"b48933f8-6743-4aee-827f-a34cf8f590d4","Type":"ContainerStarted","Data":"d03270d5b07e3eb4230cf01270ce78f8a4debdad574ee635bc8a1551a76606c4"}
Jul 06 11:29:08.820660 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.820633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:08.820792 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.820662    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:08.820792 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:08.820746    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:08.820877 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:08.820862    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:08.968834 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.968587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg" event={"ID":"b48933f8-6743-4aee-827f-a34cf8f590d4","Type":"ContainerStarted","Data":"c769ffcaa51c768aa86be86b1486bc0e3f38e022c049eb5472cf9ebd1e771eb3"}
Jul 06 11:29:08.972312 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.972290    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:29:08.972680 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.972652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"9159bf7ce5bc55e65f19018ad9c6fb057984d38ec73eb7924c6f086dd2df7ab7"}
Jul 06 11:29:08.986791 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:08.986711    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9jjg" podStartSLOduration=4.071815966 podStartE2EDuration="24.986693967s" totalImagesPullingTime="20.914878001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:08.986104669 +0000 UTC m=+25.697197200" watchObservedRunningTime="2026-07-06 11:29:08.986693967 +0000 UTC m=+25.697786545"
Jul 06 11:29:09.493478 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:09.493442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:09.580583 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:09.580555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log" limit=1024
Jul 06 11:29:09.821357 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:09.821327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:09.821514 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:09.821436    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:10.820842 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:10.820816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:10.821509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:10.820816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:10.821509 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:10.820944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:10.821509 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:10.821005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:11.821480 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.821455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:11.821943 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:11.821570    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:11.982183 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.982159    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:29:11.982450 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.982427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"bdd0e263dfeb8faf7cf43af869a6b10f080a60265a96cebb88e71e7bab745950"}
Jul 06 11:29:11.982762 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.982740    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:11.982884 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.982810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:11.982945 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.982903    2581 scope.go:117] "RemoveContainer" containerID="44f8d94745f124c75bbe472b9c086943b481bc7d13333f8f5a0f5f44a776f116"
Jul 06 11:29:11.999278 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:11.999259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:12.821520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.821490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:12.821893 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.821496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:12.821893 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:12.821584    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:12.821893 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:12.821675    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:12.989095 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.989004    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="539d7cf905a83ffbbcbcd70cc31650cb17bd6865fb2be353589eac79b4dc5e52" exitCode=0
Jul 06 11:29:12.989276 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.989092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"539d7cf905a83ffbbcbcd70cc31650cb17bd6865fb2be353589eac79b4dc5e52"}
Jul 06 11:29:12.994556 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.994505    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:29:12.994893 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.994871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" event={"ID":"a74f345f-87ae-4290-8ccd-2ddc378e7e9f","Type":"ContainerStarted","Data":"5e42b47eb7af6574534106eca5362a977f4f4598b0bb23bb2eafd8ce284d119e"}
Jul 06 11:29:12.995996 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:12.995973    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:13.014912 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.014893    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:13.053176 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.053109    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb" podStartSLOduration=10.596014773 podStartE2EDuration="29.053095755s" totalImagesPullingTime="18.457080982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:13.051915878 +0000 UTC m=+29.763008407" watchObservedRunningTime="2026-07-06 11:29:13.053095755 +0000 UTC m=+29.764188284"
Jul 06 11:29:13.664769 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.664612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qzr6n"]
Jul 06 11:29:13.664908 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.664844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:13.664956 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:13.664919    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:13.667253 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.667230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v489s"]
Jul 06 11:29:13.667354 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.667317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:13.667418 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:13.667403    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:13.669975 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.669956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fq2w2"]
Jul 06 11:29:13.670063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:13.670022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:13.670168 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:13.670127    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:15.002026 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:15.001991    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="94897d3182eb1272b34f3d93d4ced838427f0d1956c989c666f121be64984b3b" exitCode=0
Jul 06 11:29:15.002498 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:15.002079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"94897d3182eb1272b34f3d93d4ced838427f0d1956c989c666f121be64984b3b"}
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:15.822266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:15.822410    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:15.823193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:15.823331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:15.823394    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:15.823523 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:15.823489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:17.008804 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.008770    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="f651cb8e760dc2ddc5d24fc4709af1ef52a2f185d0be55fa43a616448a5e4155" exitCode=0
Jul 06 11:29:17.009560 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.008832    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"f651cb8e760dc2ddc5d24fc4709af1ef52a2f185d0be55fa43a616448a5e4155"}
Jul 06 11:29:17.450355 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.450320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:17.450501 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.450380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:17.450501 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.450472    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:29:17.450615 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.450528    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs podName:acc3219a-f3b6-4711-82d3-73c72b3fe824 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:49.450513234 +0000 UTC m=+66.161605742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs") pod "network-metrics-daemon-v489s" (UID: "acc3219a-f3b6-4711-82d3-73c72b3fe824") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 11:29:17.450615 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.450479    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 11:29:17.450696 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.450615    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret podName:3db4e29d-85fe-42e9-b0c1-41bb0943d974 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:49.450596248 +0000 UTC m=+66.161688759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret") pod "global-pull-secret-syncer-qzr6n" (UID: "3db4e29d-85fe-42e9-b0c1-41bb0943d974") : object "kube-system"/"original-pull-secret" not registered
Jul 06 11:29:17.651661 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.651587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:17.651775 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.651710    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 11:29:17.651775 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.651725    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 11:29:17.651775 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.651734    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ft2k4 for pod openshift-network-diagnostics/network-check-target-fq2w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:29:17.651879 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.651778    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4 podName:b6d7c040-c437-4af6-a154-bb2b177e06ce nodeName:}" failed. No retries permitted until 2026-07-06 11:29:49.65176526 +0000 UTC m=+66.362857768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ft2k4" (UniqueName: "kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4") pod "network-check-target-fq2w2" (UID: "b6d7c040-c437-4af6-a154-bb2b177e06ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 11:29:17.820910 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.820879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:17.821088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.820920    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:17.821088 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.820996    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fq2w2" podUID="b6d7c040-c437-4af6-a154-bb2b177e06ce"
Jul 06 11:29:17.821088 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.821051    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v489s" podUID="acc3219a-f3b6-4711-82d3-73c72b3fe824"
Jul 06 11:29:17.821088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:17.821079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:17.821321 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:17.821183    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzr6n" podUID="3db4e29d-85fe-42e9-b0c1-41bb0943d974"
Jul 06 11:29:19.541153 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.541074    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-178.ec2.internal" event="NodeReady"
Jul 06 11:29:19.541479 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.541208    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 11:29:19.594420 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.594392    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qfvb2"]
Jul 06 11:29:19.597798 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.597774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.601628 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.600815    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5rs27"]
Jul 06 11:29:19.601628 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.601221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpbrx\""
Jul 06 11:29:19.601628 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.601441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 11:29:19.601828 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.601634    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 11:29:19.625798 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.625125    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.626286 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.626251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfvb2"]
Jul 06 11:29:19.627163 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.627127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5rs27"]
Jul 06 11:29:19.627580 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.627554    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 11:29:19.627580 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.627571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 11:29:19.627840 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.627821    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 11:29:19.628230 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.628213    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-989xb\""
Jul 06 11:29:19.769861 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.769827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5523c3-3880-4183-a80a-d40eb0d9057e-tmp-dir\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.770017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.769876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c5523c3-3880-4183-a80a-d40eb0d9057e-config-volume\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.770017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.769968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.770017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.770003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpltb\" (UniqueName: \"kubernetes.io/projected/5c5523c3-3880-4183-a80a-d40eb0d9057e-kube-api-access-xpltb\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.770182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.770029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd68d20-dacd-4262-831b-1d3c947289a9-cert\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.770182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.770053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsc8l\" (UniqueName: \"kubernetes.io/projected/fdd68d20-dacd-4262-831b-1d3c947289a9-kube-api-access-dsc8l\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.821265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.821204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:19.821383 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.821314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:19.821433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.821204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:19.823717 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.823633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w64mh\""
Jul 06 11:29:19.823717 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.823638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 11:29:19.823717 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.823669    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 11:29:19.823929 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.823731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kdds4\""
Jul 06 11:29:19.824026 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.824009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 11:29:19.824092 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.824044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 11:29:19.871262 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5523c3-3880-4183-a80a-d40eb0d9057e-tmp-dir\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.871366 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c5523c3-3880-4183-a80a-d40eb0d9057e-config-volume\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.871366 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.871366 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpltb\" (UniqueName: \"kubernetes.io/projected/5c5523c3-3880-4183-a80a-d40eb0d9057e-kube-api-access-xpltb\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.871470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd68d20-dacd-4262-831b-1d3c947289a9-cert\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.871470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsc8l\" (UniqueName: \"kubernetes.io/projected/fdd68d20-dacd-4262-831b-1d3c947289a9-kube-api-access-dsc8l\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.871604 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871579    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c5523c3-3880-4183-a80a-d40eb0d9057e-tmp-dir\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.871680 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:19.871668    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:19.871755 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:19.871738    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:20.371718374 +0000 UTC m=+37.082810885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:19.871894 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.871874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c5523c3-3880-4183-a80a-d40eb0d9057e-config-volume\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.876320 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.876159    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdd68d20-dacd-4262-831b-1d3c947289a9-cert\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.880793 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.880759    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsc8l\" (UniqueName: \"kubernetes.io/projected/fdd68d20-dacd-4262-831b-1d3c947289a9-kube-api-access-dsc8l\") pod \"ingress-canary-5rs27\" (UID: \"fdd68d20-dacd-4262-831b-1d3c947289a9\") " pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:19.880793 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.880766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpltb\" (UniqueName: \"kubernetes.io/projected/5c5523c3-3880-4183-a80a-d40eb0d9057e-kube-api-access-xpltb\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:19.940635 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:19.940611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5rs27"
Jul 06 11:29:20.085375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.085342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5rs27"]
Jul 06 11:29:20.090790 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:20.090754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd68d20_dacd_4262_831b_1d3c947289a9.slice/crio-a198e1a8da3e5265eee5e4ecf3961d6ae752530a5c5088393ddcbce137b29ec2 WatchSource:0}: Error finding container a198e1a8da3e5265eee5e4ecf3961d6ae752530a5c5088393ddcbce137b29ec2: Status 404 returned error can't find the container with id a198e1a8da3e5265eee5e4ecf3961d6ae752530a5c5088393ddcbce137b29ec2
Jul 06 11:29:20.375365 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.375288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:20.375524 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:20.375460    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:20.375604 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:20.375537    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:21.375517206 +0000 UTC m=+38.086609714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:20.742806 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.742720    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"]
Jul 06 11:29:20.746433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.746408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"
Jul 06 11:29:20.748566 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.748542    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 11:29:20.748782 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.748758    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:29:20.748985 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.748967    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tppgt\""
Jul 06 11:29:20.763818 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.763795    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"]
Jul 06 11:29:20.850060 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.850027    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dbcd969f-ztlsf"]
Jul 06 11:29:20.855476 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.855448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.859021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.858564    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 11:29:20.859021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.858575    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 11:29:20.859021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.858575    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 11:29:20.859021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.858823    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 11:29:20.859021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.859001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xvj2x\""
Jul 06 11:29:20.859343 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.859183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 11:29:20.860009 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.859990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 11:29:20.867991 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.867969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dbcd969f-ztlsf"]
Jul 06 11:29:20.878764 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.878740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxcv\" (UniqueName: \"kubernetes.io/projected/2ddef93e-ff31-4e7c-a8ad-2b78daed60b3-kube-api-access-8hxcv\") pod \"volume-data-source-validator-5d456fdbcd-4jm4j\" (UID: \"2ddef93e-ff31-4e7c-a8ad-2b78daed60b3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"
Jul 06 11:29:20.960483 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.960438    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q4xh2"]
Jul 06 11:29:20.963641 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.963619    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"]
Jul 06 11:29:20.963776 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.963756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:20.966247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.966228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 11:29:20.966557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.966535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 11:29:20.966703 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.966686    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 11:29:20.967040 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.966767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:20.967040 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.966800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:29:20.967297 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.967278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-78skp\""
Jul 06 11:29:20.969536 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.969515    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 11:29:20.970096 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.969996    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 11:29:20.970218 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.970165    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:29:20.971083 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.970893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4mx2z\""
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77vqn\" (UniqueName: \"kubernetes.io/projected/996975a6-fea7-4424-9809-d98eb0d840c9-kube-api-access-77vqn\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-default-certificate\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-stats-auth\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxcv\" (UniqueName: \"kubernetes.io/projected/2ddef93e-ff31-4e7c-a8ad-2b78daed60b3-kube-api-access-8hxcv\") pod \"volume-data-source-validator-5d456fdbcd-4jm4j\" (UID: \"2ddef93e-ff31-4e7c-a8ad-2b78daed60b3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"
Jul 06 11:29:20.979665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:20.979976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q4xh2"]
Jul 06 11:29:20.979976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.979806    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 11:29:20.984439 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.984382    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"]
Jul 06 11:29:20.999433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:20.999379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxcv\" (UniqueName: \"kubernetes.io/projected/2ddef93e-ff31-4e7c-a8ad-2b78daed60b3-kube-api-access-8hxcv\") pod \"volume-data-source-validator-5d456fdbcd-4jm4j\" (UID: \"2ddef93e-ff31-4e7c-a8ad-2b78daed60b3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"
Jul 06 11:29:21.021348 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.021313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5rs27" event={"ID":"fdd68d20-dacd-4262-831b-1d3c947289a9","Type":"ContainerStarted","Data":"a198e1a8da3e5265eee5e4ecf3961d6ae752530a5c5088393ddcbce137b29ec2"}
Jul 06 11:29:21.058568 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.058537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"
Jul 06 11:29:21.080025 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.079997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-serving-cert\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.080167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.080167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhb8\" (UniqueName: \"kubernetes.io/projected/aabe0db3-fe7a-48cf-9eec-7db5c9559774-kube-api-access-clhb8\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.080167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-trusted-ca\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.080167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-config\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77vqn\" (UniqueName: \"kubernetes.io/projected/996975a6-fea7-4424-9809-d98eb0d840c9-kube-api-access-77vqn\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.080217    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:21.580195998 +0000 UTC m=+38.291288524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm9p9\" (UniqueName: \"kubernetes.io/projected/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-kube-api-access-vm9p9\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-default-certificate\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-stats-auth\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.080389 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.080368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.080977 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.080890    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:21.080977 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.080956    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:21.580938333 +0000 UTC m=+38.292030859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:21.083488 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.083449    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-stats-auth\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.083564 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.083498    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-default-certificate\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.096795 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.096772    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77vqn\" (UniqueName: \"kubernetes.io/projected/996975a6-fea7-4424-9809-d98eb0d840c9-kube-api-access-77vqn\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.181283 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm9p9\" (UniqueName: \"kubernetes.io/projected/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-kube-api-access-vm9p9\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.181460 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.181569 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-serving-cert\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.181569 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhb8\" (UniqueName: \"kubernetes.io/projected/aabe0db3-fe7a-48cf-9eec-7db5c9559774-kube-api-access-clhb8\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.181651 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-trusted-ca\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.181651 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.181625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-config\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.181651 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.181642    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 11:29:21.181763 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.181698    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls podName:aabe0db3-fe7a-48cf-9eec-7db5c9559774 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:21.681680375 +0000 UTC m=+38.392772902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mqjrd" (UID: "aabe0db3-fe7a-48cf-9eec-7db5c9559774") : secret "samples-operator-tls" not found
Jul 06 11:29:21.182504 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.182470    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-config\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.182696 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.182676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-trusted-ca\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.184771 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.184741    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-serving-cert\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.191836 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.191813    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm9p9\" (UniqueName: \"kubernetes.io/projected/1c8c16d9-3863-4a7b-a4ba-1ae683202eec-kube-api-access-vm9p9\") pod \"console-operator-68b757fb67-q4xh2\" (UID: \"1c8c16d9-3863-4a7b-a4ba-1ae683202eec\") " pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.192968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.192947    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhb8\" (UniqueName: \"kubernetes.io/projected/aabe0db3-fe7a-48cf-9eec-7db5c9559774-kube-api-access-clhb8\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.277073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.277041    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:21.383267 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.383229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:21.383446 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.383423    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:21.383540 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.383502    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:23.383484786 +0000 UTC m=+40.094577294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:21.585045 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.584964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.585045 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.585034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:21.585278 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.585173    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:22.585131364 +0000 UTC m=+39.296223876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:21.585338 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.585276    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:21.585338 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.585336    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:22.585320328 +0000 UTC m=+39.296412842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:21.685759 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:21.685727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:21.685933 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.685911    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 11:29:21.685988 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:21.685977    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls podName:aabe0db3-fe7a-48cf-9eec-7db5c9559774 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:22.685960297 +0000 UTC m=+39.397052806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mqjrd" (UID: "aabe0db3-fe7a-48cf-9eec-7db5c9559774") : secret "samples-operator-tls" not found
Jul 06 11:29:22.593590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:22.593550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:22.594007 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:22.593635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:22.594007 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:22.593716    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:22.594007 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:22.593789    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:24.593770078 +0000 UTC m=+41.304862590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:22.594007 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:22.593838    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:24.593817986 +0000 UTC m=+41.304910498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:22.694846 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:22.694817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:22.694993 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:22.694977    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 11:29:22.695067 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:22.695044    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls podName:aabe0db3-fe7a-48cf-9eec-7db5c9559774 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:24.695027754 +0000 UTC m=+41.406120263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mqjrd" (UID: "aabe0db3-fe7a-48cf-9eec-7db5c9559774") : secret "samples-operator-tls" not found
Jul 06 11:29:23.400292 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:23.400260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:23.400467 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:23.400428    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:23.400532 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:23.400506    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:27.400486413 +0000 UTC m=+44.111578926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:23.608861 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:23.608836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j"]
Jul 06 11:29:23.612677 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:23.612645    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddef93e_ff31_4e7c_a8ad_2b78daed60b3.slice/crio-a4d19f22ce0dba554a2c600cea67e2554795c91be8bf998dda0694bb26fb6be8 WatchSource:0}: Error finding container a4d19f22ce0dba554a2c600cea67e2554795c91be8bf998dda0694bb26fb6be8: Status 404 returned error can't find the container with id a4d19f22ce0dba554a2c600cea67e2554795c91be8bf998dda0694bb26fb6be8
Jul 06 11:29:23.624472 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:23.624447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q4xh2"]
Jul 06 11:29:23.628475 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:23.628448    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8c16d9_3863_4a7b_a4ba_1ae683202eec.slice/crio-ba0b21a3db23490428ef11159b5c121aa2deaa9ffb785188c305e4f6d98467ca WatchSource:0}: Error finding container ba0b21a3db23490428ef11159b5c121aa2deaa9ffb785188c305e4f6d98467ca: Status 404 returned error can't find the container with id ba0b21a3db23490428ef11159b5c121aa2deaa9ffb785188c305e4f6d98467ca
Jul 06 11:29:24.029115 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.029070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" event={"ID":"1c8c16d9-3863-4a7b-a4ba-1ae683202eec","Type":"ContainerStarted","Data":"ba0b21a3db23490428ef11159b5c121aa2deaa9ffb785188c305e4f6d98467ca"}
Jul 06 11:29:24.030114 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.030090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j" event={"ID":"2ddef93e-ff31-4e7c-a8ad-2b78daed60b3","Type":"ContainerStarted","Data":"a4d19f22ce0dba554a2c600cea67e2554795c91be8bf998dda0694bb26fb6be8"}
Jul 06 11:29:24.032700 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.032681    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="5becec1573f21b763937ff2ba3b081c3ecef828f185faff58fa028e4ab34f142" exitCode=0
Jul 06 11:29:24.032792 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.032768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"5becec1573f21b763937ff2ba3b081c3ecef828f185faff58fa028e4ab34f142"}
Jul 06 11:29:24.034110 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.034091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5rs27" event={"ID":"fdd68d20-dacd-4262-831b-1d3c947289a9","Type":"ContainerStarted","Data":"e99baab413c255fc7b3c4f0e3f3c8b2b59d6c92b74a2a8609099c35f844cc4ed"}
Jul 06 11:29:24.078032 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.077980    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5rs27" podStartSLOduration=1.692823181 podStartE2EDuration="5.077960338s" totalImagesPullingTime="3.385137157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:24.077817433 +0000 UTC m=+40.788909963" watchObservedRunningTime="2026-07-06 11:29:24.077960338 +0000 UTC m=+40.789052869"
Jul 06 11:29:24.612439 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.612129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:24.612439 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.612258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:24.612439 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:24.612256    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:24.612439 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:24.612381    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:28.612362028 +0000 UTC m=+45.323454540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:24.612439 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:24.612402    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:28.612392392 +0000 UTC m=+45.323484900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:24.713084 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:24.712997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:24.713262 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:24.713182    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 11:29:24.713262 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:24.713256    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls podName:aabe0db3-fe7a-48cf-9eec-7db5c9559774 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:28.713236338 +0000 UTC m=+45.424328850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mqjrd" (UID: "aabe0db3-fe7a-48cf-9eec-7db5c9559774") : secret "samples-operator-tls" not found
Jul 06 11:29:25.042633 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.042594    2581 generic.go:356] "Generic (PLEG): container finished" podID="e81213a7-0dcf-4d59-93f2-34481ca0422a" containerID="832cc5036a5d1e758c6c5f64ad9634cd41cfbabdf1231a1fac39d278b234b48d" exitCode=0
Jul 06 11:29:25.044101 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.043485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerDied","Data":"832cc5036a5d1e758c6c5f64ad9634cd41cfbabdf1231a1fac39d278b234b48d"}
Jul 06 11:29:25.688088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.688046    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxqtx"]
Jul 06 11:29:25.710507 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.710470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxqtx"]
Jul 06 11:29:25.710650 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.710615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.712724 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.712700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 11:29:25.712853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.712774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 11:29:25.712853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.712791    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 11:29:25.712853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.712816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcchr\""
Jul 06 11:29:25.713120 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.713097    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 11:29:25.822333 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.822301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-crio-socket\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.822520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.822364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.822520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.822462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-data-volume\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.822520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.822495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrsdt\" (UniqueName: \"kubernetes.io/projected/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-api-access-jrsdt\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.822685 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.822559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-crio-socket\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:25.923276    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:25.923348    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:26.423327595 +0000 UTC m=+43.134420110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : configmap "kube-rbac-proxy" not found
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:25.923357    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:25.923376 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-crio-socket\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923673 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:25.923412    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:26.42340031 +0000 UTC m=+43.134492818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:25.923673 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-data-volume\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923673 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrsdt\" (UniqueName: \"kubernetes.io/projected/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-api-access-jrsdt\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.923823 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.923780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-data-volume\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:25.933663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:25.933635    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrsdt\" (UniqueName: \"kubernetes.io/projected/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-api-access-jrsdt\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:26.048345 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:26.048311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" event={"ID":"e81213a7-0dcf-4d59-93f2-34481ca0422a","Type":"ContainerStarted","Data":"b6604bada6789fd1a54088ea81fe4b56385bf51dd9291e25fba46639c3d096da"}
Jul 06 11:29:26.073609 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:26.073572    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmbl7" podStartSLOduration=8.381260215 podStartE2EDuration="42.073558014s" totalImagesPullingTime="33.692297799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:26.072406327 +0000 UTC m=+42.783498862" watchObservedRunningTime="2026-07-06 11:29:26.073558014 +0000 UTC m=+42.784650545"
Jul 06 11:29:26.428175 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:26.428153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:26.428272 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:26.428220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:26.428324 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:26.428275    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 11:29:26.428382 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:26.428332    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:26.428382 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:26.428346    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:27.42832569 +0000 UTC m=+44.139418198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : configmap "kube-rbac-proxy" not found
Jul 06 11:29:26.428476 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:26.428381    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:27.428365178 +0000 UTC m=+44.139457693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:27.051947 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.051920    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/0.log"
Jul 06 11:29:27.052339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.051958    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c8c16d9-3863-4a7b-a4ba-1ae683202eec" containerID="e96fe05ac9b20af342703cda8cd39117476ced94426dc3f217a768b1644713a2" exitCode=255
Jul 06 11:29:27.052339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.052021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" event={"ID":"1c8c16d9-3863-4a7b-a4ba-1ae683202eec","Type":"ContainerDied","Data":"e96fe05ac9b20af342703cda8cd39117476ced94426dc3f217a768b1644713a2"}
Jul 06 11:29:27.052339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.052251    2581 scope.go:117] "RemoveContainer" containerID="e96fe05ac9b20af342703cda8cd39117476ced94426dc3f217a768b1644713a2"
Jul 06 11:29:27.053759 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.053732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j" event={"ID":"2ddef93e-ff31-4e7c-a8ad-2b78daed60b3","Type":"ContainerStarted","Data":"e6ee39ad3dead91c8120ec09b73590cb52f159fa1699560f42638ab0502a4bf0"}
Jul 06 11:29:27.106826 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.106739    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-4jm4j" podStartSLOduration=4.668722773 podStartE2EDuration="7.106719101s" totalImagesPullingTime="2.437996328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:27.105975249 +0000 UTC m=+43.817067780" watchObservedRunningTime="2026-07-06 11:29:27.106719101 +0000 UTC m=+43.817811633"
Jul 06 11:29:27.437164 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.437072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:27.437164 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.437126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:27.437336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.437188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:27.437336 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437195    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 11:29:27.437336 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437255    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:29.437238647 +0000 UTC m=+46.148331155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : configmap "kube-rbac-proxy" not found
Jul 06 11:29:27.437336 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437291    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:27.437336 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:35.437316425 +0000 UTC m=+52.148408936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:27.437497 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437341    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:27.437497 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:27.437386    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:29.437371989 +0000 UTC m=+46.148464501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:27.867854 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:27.867829    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fskrh_a443af82-1b06-45a9-93cd-13f87a30384e/dns-node-resolver/0.log"
Jul 06 11:29:28.057940 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.057914    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:29:28.058333 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.058322    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/0.log"
Jul 06 11:29:28.058381 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.058355    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c8c16d9-3863-4a7b-a4ba-1ae683202eec" containerID="a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d" exitCode=255
Jul 06 11:29:28.058457 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.058435    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" event={"ID":"1c8c16d9-3863-4a7b-a4ba-1ae683202eec","Type":"ContainerDied","Data":"a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d"}
Jul 06 11:29:28.058498 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.058488    2581 scope.go:117] "RemoveContainer" containerID="e96fe05ac9b20af342703cda8cd39117476ced94426dc3f217a768b1644713a2"
Jul 06 11:29:28.058724 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.058700    2581 scope.go:117] "RemoveContainer" containerID="a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d"
Jul 06 11:29:28.058885 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.058867    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q4xh2_openshift-console-operator(1c8c16d9-3863-4a7b-a4ba-1ae683202eec)\"" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" podUID="1c8c16d9-3863-4a7b-a4ba-1ae683202eec"
Jul 06 11:29:28.263035 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.263012    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pjf4_d2d8b0c8-c11a-4c74-a235-c128d84e70e2/node-ca/0.log"
Jul 06 11:29:28.648158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.648058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:28.648158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.648126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:28.648346 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.648232    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:36.648213557 +0000 UTC m=+53.359306066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:28.648346 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.648261    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:28.648346 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.648305    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:36.648290574 +0000 UTC m=+53.359383083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:28.749028 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:28.748997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:28.749186 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.749123    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 11:29:28.749325 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:28.749211    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls podName:aabe0db3-fe7a-48cf-9eec-7db5c9559774 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:36.749197327 +0000 UTC m=+53.460289837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mqjrd" (UID: "aabe0db3-fe7a-48cf-9eec-7db5c9559774") : secret "samples-operator-tls" not found
Jul 06 11:29:29.062533 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:29.062510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:29:29.062874 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:29.062835    2581 scope.go:117] "RemoveContainer" containerID="a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d"
Jul 06 11:29:29.062977 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:29.062956    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q4xh2_openshift-console-operator(1c8c16d9-3863-4a7b-a4ba-1ae683202eec)\"" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" podUID="1c8c16d9-3863-4a7b-a4ba-1ae683202eec"
Jul 06 11:29:29.069583 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:29.069564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5rs27_fdd68d20-dacd-4262-831b-1d3c947289a9/serve-healthcheck-canary/0.log"
Jul 06 11:29:29.453874 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:29.453792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:29.453874 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:29.453846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:29.454052 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:29.453905    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 11:29:29.454052 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:29.453941    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:29.454052 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:29.453964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:33.45394955 +0000 UTC m=+50.165042058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : configmap "kube-rbac-proxy" not found
Jul 06 11:29:29.454052 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:29.453980    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:33.453969645 +0000 UTC m=+50.165062155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:31.277369 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:31.277334    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:31.277803 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:31.277383    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:31.277803 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:31.277700    2581 scope.go:117] "RemoveContainer" containerID="a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d"
Jul 06 11:29:31.277871 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:31.277838    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q4xh2_openshift-console-operator(1c8c16d9-3863-4a7b-a4ba-1ae683202eec)\"" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" podUID="1c8c16d9-3863-4a7b-a4ba-1ae683202eec"
Jul 06 11:29:33.481233 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:33.481194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:33.481636 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:33.481250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:33.481636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:33.481316    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 11:29:33.481636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:33.481329    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:33.481636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:33.481408    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:41.481387941 +0000 UTC m=+58.192480464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : configmap "kube-rbac-proxy" not found
Jul 06 11:29:33.481636 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:33.481446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:41.481433555 +0000 UTC m=+58.192526077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:35.494619 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:35.494573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:35.495089 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:35.494745    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 11:29:35.495089 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:35.494812    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls podName:5c5523c3-3880-4183-a80a-d40eb0d9057e nodeName:}" failed. No retries permitted until 2026-07-06 11:29:51.494795545 +0000 UTC m=+68.205888055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls") pod "dns-default-qfvb2" (UID: "5c5523c3-3880-4183-a80a-d40eb0d9057e") : secret "dns-default-metrics-tls" not found
Jul 06 11:29:36.705190 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:36.705154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:36.705602 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:36.705251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:36.705602 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:36.705292    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 11:29:36.705602 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:36.705353    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:52.705338998 +0000 UTC m=+69.416431506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : secret "router-metrics-certs-default" not found
Jul 06 11:29:36.705602 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:36.705386    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle podName:996975a6-fea7-4424-9809-d98eb0d840c9 nodeName:}" failed. No retries permitted until 2026-07-06 11:29:52.705370659 +0000 UTC m=+69.416463174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle") pod "router-default-dbcd969f-ztlsf" (UID: "996975a6-fea7-4424-9809-d98eb0d840c9") : configmap references non-existent config key: service-ca.crt
Jul 06 11:29:36.806225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:36.806191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:36.808499 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:36.808477    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aabe0db3-fe7a-48cf-9eec-7db5c9559774-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mqjrd\" (UID: \"aabe0db3-fe7a-48cf-9eec-7db5c9559774\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:36.885427 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:36.885407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"
Jul 06 11:29:37.021058 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:37.021026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd"]
Jul 06 11:29:38.088394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:38.088347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd" event={"ID":"aabe0db3-fe7a-48cf-9eec-7db5c9559774","Type":"ContainerStarted","Data":"8fe5d7c05a9da5b64bb65f13c1b82c44d7e10752d9ee155e8a01bc74600a7487"}
Jul 06 11:29:40.095331 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:40.095296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd" event={"ID":"aabe0db3-fe7a-48cf-9eec-7db5c9559774","Type":"ContainerStarted","Data":"c3d230f831b12f95ae2aef0995059c930f119f5d25a8cd93693e608b9fcc9dad"}
Jul 06 11:29:40.095713 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:40.095348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd" event={"ID":"aabe0db3-fe7a-48cf-9eec-7db5c9559774","Type":"ContainerStarted","Data":"8979598323b49052c3eddee0516dbf3369a9ad3e63053cbf0370b1c20caf0064"}
Jul 06 11:29:40.118520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:40.118455    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mqjrd" podStartSLOduration=18.105790136 podStartE2EDuration="20.118434308s" totalImagesPullingTime="2.012644172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:40.11770286 +0000 UTC m=+56.828795391" watchObservedRunningTime="2026-07-06 11:29:40.118434308 +0000 UTC m=+56.829526838"
Jul 06 11:29:41.543266 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:41.543229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:41.543651 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:41.543343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:41.543651 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:41.543373    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:41.543651 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:29:41.543441    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls podName:9c1659c4-3dbb-4036-bdd1-62177f5ff7dc nodeName:}" failed. No retries permitted until 2026-07-06 11:29:57.543426152 +0000 UTC m=+74.254518660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bxqtx" (UID: "9c1659c4-3dbb-4036-bdd1-62177f5ff7dc") : secret "insights-runtime-extractor-tls" not found
Jul 06 11:29:41.543820 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:41.543803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:43.823015 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:43.822982    2581 scope.go:117] "RemoveContainer" containerID="a7b36ac3659540fa195dc377d0eb41bdae27816e958e3c7b465501583a54361d"
Jul 06 11:29:44.110075 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:44.109993    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:29:44.110075 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:44.110050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" event={"ID":"1c8c16d9-3863-4a7b-a4ba-1ae683202eec","Type":"ContainerStarted","Data":"b144c57f92ddbe2ff45e8cefcaa73b1c3b5829c4c4637a75055fc334177e5c48"}
Jul 06 11:29:44.110360 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:44.110331    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:44.129192 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:44.129127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2" podStartSLOduration=21.363708845 podStartE2EDuration="24.129112218s" totalImagesPullingTime="2.765403373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:44.128671016 +0000 UTC m=+60.839763548" watchObservedRunningTime="2026-07-06 11:29:44.129112218 +0000 UTC m=+60.840204748"
Jul 06 11:29:44.324181 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:44.324152    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-q4xh2"
Jul 06 11:29:45.017884 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:45.017860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vg4jb"
Jul 06 11:29:49.503396 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.503357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:49.503860 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.503421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:49.505922 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.505898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 11:29:49.506305 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.506291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 11:29:49.516033 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.516010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3db4e29d-85fe-42e9-b0c1-41bb0943d974-original-pull-secret\") pod \"global-pull-secret-syncer-qzr6n\" (UID: \"3db4e29d-85fe-42e9-b0c1-41bb0943d974\") " pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:49.516118 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.516042    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acc3219a-f3b6-4711-82d3-73c72b3fe824-metrics-certs\") pod \"network-metrics-daemon-v489s\" (UID: \"acc3219a-f3b6-4711-82d3-73c72b3fe824\") " pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:49.536208 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.536190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzr6n"
Jul 06 11:29:49.543071 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.543053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w64mh\""
Jul 06 11:29:49.550797 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.550779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v489s"
Jul 06 11:29:49.667129 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.667104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qzr6n"]
Jul 06 11:29:49.670129 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:49.670105    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db4e29d_85fe_42e9_b0c1_41bb0943d974.slice/crio-d2d832dbf15cc26556d6c3c8b8ae8afa85167cb430d0dd8dd727cbfd733e64e1 WatchSource:0}: Error finding container d2d832dbf15cc26556d6c3c8b8ae8afa85167cb430d0dd8dd727cbfd733e64e1: Status 404 returned error can't find the container with id d2d832dbf15cc26556d6c3c8b8ae8afa85167cb430d0dd8dd727cbfd733e64e1
Jul 06 11:29:49.682855 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.682832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v489s"]
Jul 06 11:29:49.685270 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:49.685249    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc3219a_f3b6_4711_82d3_73c72b3fe824.slice/crio-fb85ad6895ae14f92eb1936e4cee9339944b54ae8154e94201b0d5fdf6e7be84 WatchSource:0}: Error finding container fb85ad6895ae14f92eb1936e4cee9339944b54ae8154e94201b0d5fdf6e7be84: Status 404 returned error can't find the container with id fb85ad6895ae14f92eb1936e4cee9339944b54ae8154e94201b0d5fdf6e7be84
Jul 06 11:29:49.705476 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.705450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:49.708152 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.708121    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 11:29:49.718481 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.718465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 11:29:49.729533 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.729512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2k4\" (UniqueName: \"kubernetes.io/projected/b6d7c040-c437-4af6-a154-bb2b177e06ce-kube-api-access-ft2k4\") pod \"network-check-target-fq2w2\" (UID: \"b6d7c040-c437-4af6-a154-bb2b177e06ce\") " pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:49.832731 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.832675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kdds4\""
Jul 06 11:29:49.841440 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.841427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:49.958150 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:49.958099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fq2w2"]
Jul 06 11:29:49.961650 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:49.961618    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d7c040_c437_4af6_a154_bb2b177e06ce.slice/crio-251d33dfb359977c4d0f8f1077ef9b28811685f2fa1ccd47dff40051c1c59bc7 WatchSource:0}: Error finding container 251d33dfb359977c4d0f8f1077ef9b28811685f2fa1ccd47dff40051c1c59bc7: Status 404 returned error can't find the container with id 251d33dfb359977c4d0f8f1077ef9b28811685f2fa1ccd47dff40051c1c59bc7
Jul 06 11:29:50.129517 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:50.129434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v489s" event={"ID":"acc3219a-f3b6-4711-82d3-73c72b3fe824","Type":"ContainerStarted","Data":"fb85ad6895ae14f92eb1936e4cee9339944b54ae8154e94201b0d5fdf6e7be84"}
Jul 06 11:29:50.130753 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:50.130718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qzr6n" event={"ID":"3db4e29d-85fe-42e9-b0c1-41bb0943d974","Type":"ContainerStarted","Data":"d2d832dbf15cc26556d6c3c8b8ae8afa85167cb430d0dd8dd727cbfd733e64e1"}
Jul 06 11:29:50.132025 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:50.131999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fq2w2" event={"ID":"b6d7c040-c437-4af6-a154-bb2b177e06ce","Type":"ContainerStarted","Data":"251d33dfb359977c4d0f8f1077ef9b28811685f2fa1ccd47dff40051c1c59bc7"}
Jul 06 11:29:51.137426 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.137391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v489s" event={"ID":"acc3219a-f3b6-4711-82d3-73c72b3fe824","Type":"ContainerStarted","Data":"84c18fc032b234cea1242ef6e8f4999abe922437ccec173d0070cade6b562144"}
Jul 06 11:29:51.519466 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.519434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:51.522296 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.522265    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c5523c3-3880-4183-a80a-d40eb0d9057e-metrics-tls\") pod \"dns-default-qfvb2\" (UID: \"5c5523c3-3880-4183-a80a-d40eb0d9057e\") " pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:51.736826 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.736790    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpbrx\""
Jul 06 11:29:51.745204 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.745165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:51.922689 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:51.922658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qfvb2"]
Jul 06 11:29:51.926827 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:51.926791    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5523c3_3880_4183_a80a_d40eb0d9057e.slice/crio-da201e3783f1042c6f6fdf7c18f838d655b6d02573684c1fabcf978ba8be4cf5 WatchSource:0}: Error finding container da201e3783f1042c6f6fdf7c18f838d655b6d02573684c1fabcf978ba8be4cf5: Status 404 returned error can't find the container with id da201e3783f1042c6f6fdf7c18f838d655b6d02573684c1fabcf978ba8be4cf5
Jul 06 11:29:52.144048 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.143969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfvb2" event={"ID":"5c5523c3-3880-4183-a80a-d40eb0d9057e","Type":"ContainerStarted","Data":"da201e3783f1042c6f6fdf7c18f838d655b6d02573684c1fabcf978ba8be4cf5"}
Jul 06 11:29:52.146312 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.146280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v489s" event={"ID":"acc3219a-f3b6-4711-82d3-73c72b3fe824","Type":"ContainerStarted","Data":"63deb06362797ca2f019e99ac3bb1944938e0f73359a0c66ef464a622300cd7e"}
Jul 06 11:29:52.189233 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.189171    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v489s" podStartSLOduration=66.874182624 podStartE2EDuration="1m8.189151784s" totalImagesPullingTime="1.31496916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:52.186358791 +0000 UTC m=+68.897451321" watchObservedRunningTime="2026-07-06 11:29:52.189151784 +0000 UTC m=+68.900244305"
Jul 06 11:29:52.729809 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.729774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:52.729999 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.729863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:52.730612 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.730581    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/996975a6-fea7-4424-9809-d98eb0d840c9-service-ca-bundle\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:52.732438 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.732410    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/996975a6-fea7-4424-9809-d98eb0d840c9-metrics-certs\") pod \"router-default-dbcd969f-ztlsf\" (UID: \"996975a6-fea7-4424-9809-d98eb0d840c9\") " pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:52.970605 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.970573    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xvj2x\""
Jul 06 11:29:52.979231 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:52.979203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:54.978547 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:54.978505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dbcd969f-ztlsf"]
Jul 06 11:29:55.158435 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:55.158352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qzr6n" event={"ID":"3db4e29d-85fe-42e9-b0c1-41bb0943d974","Type":"ContainerStarted","Data":"edd6485c473541e45af7fcc58648518093868bdceba5f7fdf823a6c9cfefbb95"}
Jul 06 11:29:55.160336 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:55.160301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fq2w2" event={"ID":"b6d7c040-c437-4af6-a154-bb2b177e06ce","Type":"ContainerStarted","Data":"13ba8e3329433b5e349fc0ea3561abefc039fc74e38efb0df347d34106814157"}
Jul 06 11:29:55.160481 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:55.160376    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:29:55.174573 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:55.174524    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qzr6n" podStartSLOduration=66.034332842 podStartE2EDuration="1m11.174507688s" totalImagesPullingTime="5.140174846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:55.17443373 +0000 UTC m=+71.885526262" watchObservedRunningTime="2026-07-06 11:29:55.174507688 +0000 UTC m=+71.885600222"
Jul 06 11:29:55.195547 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:55.195500    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fq2w2" podStartSLOduration=66.346220503 podStartE2EDuration="1m11.195486125s" totalImagesPullingTime="4.849265622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:55.19384347 +0000 UTC m=+71.904936013" watchObservedRunningTime="2026-07-06 11:29:55.195486125 +0000 UTC m=+71.906578654"
Jul 06 11:29:55.406286 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:55.406247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996975a6_fea7_4424_9809_d98eb0d840c9.slice/crio-c809da90f8d9651d1677ce85a6d33f9e6d43154b8bd219eb36cc1e67b99fff90 WatchSource:0}: Error finding container c809da90f8d9651d1677ce85a6d33f9e6d43154b8bd219eb36cc1e67b99fff90: Status 404 returned error can't find the container with id c809da90f8d9651d1677ce85a6d33f9e6d43154b8bd219eb36cc1e67b99fff90
Jul 06 11:29:56.166248 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.166213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfvb2" event={"ID":"5c5523c3-3880-4183-a80a-d40eb0d9057e","Type":"ContainerStarted","Data":"11adc39208815ba4043edf75c357edfb89ff12b2c4b2e3c338e455a40633693c"}
Jul 06 11:29:56.166642 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.166264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qfvb2" event={"ID":"5c5523c3-3880-4183-a80a-d40eb0d9057e","Type":"ContainerStarted","Data":"4b0622d961d5195869773b9683399e6c1e455b0f702032360aa26ff5199e6eac"}
Jul 06 11:29:56.166642 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.166326    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:29:56.167694 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.167665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dbcd969f-ztlsf" event={"ID":"996975a6-fea7-4424-9809-d98eb0d840c9","Type":"ContainerStarted","Data":"182eefcdd9947cb6b2b0211901de427e82ac0085a743749be10888743d9a0431"}
Jul 06 11:29:56.167809 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.167702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dbcd969f-ztlsf" event={"ID":"996975a6-fea7-4424-9809-d98eb0d840c9","Type":"ContainerStarted","Data":"c809da90f8d9651d1677ce85a6d33f9e6d43154b8bd219eb36cc1e67b99fff90"}
Jul 06 11:29:56.192816 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.192760    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qfvb2" podStartSLOduration=33.677177926 podStartE2EDuration="37.192742025s" totalImagesPullingTime="3.515564099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:56.192130552 +0000 UTC m=+72.903223083" watchObservedRunningTime="2026-07-06 11:29:56.192742025 +0000 UTC m=+72.903834557"
Jul 06 11:29:56.220377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.220335    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dbcd969f-ztlsf" podStartSLOduration=36.22032247 podStartE2EDuration="36.22032247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:29:56.219805555 +0000 UTC m=+72.930898085" watchObservedRunningTime="2026-07-06 11:29:56.22032247 +0000 UTC m=+72.931415000"
Jul 06 11:29:56.979667 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.979623    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:56.982147 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:56.982114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:57.171582 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.171554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:57.172614 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.172590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dbcd969f-ztlsf"
Jul 06 11:29:57.573324 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.573292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:57.575599 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.575580    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9c1659c4-3dbb-4036-bdd1-62177f5ff7dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxqtx\" (UID: \"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc\") " pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:57.823687 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.823612    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcchr\""
Jul 06 11:29:57.832225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.832204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxqtx"
Jul 06 11:29:57.954401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:57.954372    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxqtx"]
Jul 06 11:29:57.957349 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:57.957324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1659c4_3dbb_4036_bdd1_62177f5ff7dc.slice/crio-7b5ffa411dc369670ac9aab9336097fabe08253168f73ce84478f2053d35c128 WatchSource:0}: Error finding container 7b5ffa411dc369670ac9aab9336097fabe08253168f73ce84478f2053d35c128: Status 404 returned error can't find the container with id 7b5ffa411dc369670ac9aab9336097fabe08253168f73ce84478f2053d35c128
Jul 06 11:29:58.176770 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.176683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxqtx" event={"ID":"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc","Type":"ContainerStarted","Data":"7b5ffa411dc369670ac9aab9336097fabe08253168f73ce84478f2053d35c128"}
Jul 06 11:29:58.655716 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.655283    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"]
Jul 06 11:29:58.658558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.658534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.662476 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.662267    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 11:29:58.663091 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.663068    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 11:29:58.663211 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.663089    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 11:29:58.665056 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.665030    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 11:29:58.672108 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.672012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"]
Jul 06 11:29:58.758558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.758519    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"]
Jul 06 11:29:58.761826 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.761805    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:29:58.762031 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.762008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:29:58.764675 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.764654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h8rhz\""
Jul 06 11:29:58.765240 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.765008    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 11:29:58.765356 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.765267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.767816 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.767794    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.768466    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.768687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.769095    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.769341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.769564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.769625    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 11:29:58.770073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.769861    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2vsbz\""
Jul 06 11:29:58.773841 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.773815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"]
Jul 06 11:29:58.776116 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.776073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:29:58.781167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.781127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6970189-9754-438a-92d2-32b4478e3acc-tmp\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.781265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.781175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6fn\" (UniqueName: \"kubernetes.io/projected/d6970189-9754-438a-92d2-32b4478e3acc-kube-api-access-pt6fn\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.781265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.781206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d6970189-9754-438a-92d2-32b4478e3acc-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.804465 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.804422    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c74797bf4-mw8xb"]
Jul 06 11:29:58.807879 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.807856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.811520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.811496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 11:29:58.812026 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.812003    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 11:29:58.812367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.812346    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rbs4n\""
Jul 06 11:29:58.812442 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.812382    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 11:29:58.820995 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.820978    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 11:29:58.835014 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.823730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c74797bf4-mw8xb"]
Jul 06 11:29:58.882146 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-bound-sa-token\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882296 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcpxd\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-kube-api-access-fcpxd\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882362 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6970189-9754-438a-92d2-32b4478e3acc-tmp\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.882362 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d6970189-9754-438a-92d2-32b4478e3acc-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.882470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.882470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-image-registry-private-configuration\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bb56472-2da3-44fc-b899-e9d00164cca3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8nx4t\" (UID: \"9bb56472-2da3-44fc-b899-e9d00164cca3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:29:58.882470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-certificates\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc5mx\" (UniqueName: \"kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-trusted-ca\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64f3ecc1-7aed-47ae-8510-9c55bf693378-ca-trust-extracted\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6fn\" (UniqueName: \"kubernetes.io/projected/d6970189-9754-438a-92d2-32b4478e3acc-kube-api-access-pt6fn\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.882663 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.883008 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-tls\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.883008 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-installation-pull-secrets\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.883008 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.882727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.883401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.883322    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6970189-9754-438a-92d2-32b4478e3acc-tmp\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.888765 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.888742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d6970189-9754-438a-92d2-32b4478e3acc-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.910483 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.910423    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6fn\" (UniqueName: \"kubernetes.io/projected/d6970189-9754-438a-92d2-32b4478e3acc-kube-api-access-pt6fn\") pod \"klusterlet-addon-workmgr-7dc97b6844-hbhvd\" (UID: \"d6970189-9754-438a-92d2-32b4478e3acc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.975548 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.975514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:29:58.984166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.983789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bb56472-2da3-44fc-b899-e9d00164cca3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8nx4t\" (UID: \"9bb56472-2da3-44fc-b899-e9d00164cca3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:29:58.984166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.984044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-certificates\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.984438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.985180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.984492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc5mx\" (UniqueName: \"kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.985180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.984527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-trusted-ca\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.984862    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64f3ecc1-7aed-47ae-8510-9c55bf693378-ca-trust-extracted\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985628 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/64f3ecc1-7aed-47ae-8510-9c55bf693378-ca-trust-extracted\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985628 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.985749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.985749 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-tls\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985847 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-installation-pull-secrets\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.985898 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.985947 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.985902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-bound-sa-token\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.986804 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.986043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcpxd\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-kube-api-access-fcpxd\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.986804 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.986097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.986804 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.986155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-image-registry-private-configuration\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.988166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.987526    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bb56472-2da3-44fc-b899-e9d00164cca3-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-8nx4t\" (UID: \"9bb56472-2da3-44fc-b899-e9d00164cca3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:29:58.988775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.988413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.988775 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.988483    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.990565 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.990530    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.990664 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.990589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-trusted-ca\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.991702 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.990532    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.994364 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.994303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-installation-pull-secrets\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.995328 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.994693    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:58.995328 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.995183    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-certificates\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.999103 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.998296    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-registry-tls\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:58.999103 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:58.998559    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc5mx\" (UniqueName: \"kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx\") pod \"console-8574fc974-nfwz4\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") " pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:59.001418 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.000882    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-bound-sa-token\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:59.001418 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.001379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/64f3ecc1-7aed-47ae-8510-9c55bf693378-image-registry-private-configuration\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:59.001699 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.001659    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcpxd\" (UniqueName: \"kubernetes.io/projected/64f3ecc1-7aed-47ae-8510-9c55bf693378-kube-api-access-fcpxd\") pod \"image-registry-c74797bf4-mw8xb\" (UID: \"64f3ecc1-7aed-47ae-8510-9c55bf693378\") " pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:59.082743 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.082706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:29:59.090076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.089833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:29:59.121897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.121793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:29:59.150929 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.150324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"]
Jul 06 11:29:59.161157 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:59.161067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6970189_9754_438a_92d2_32b4478e3acc.slice/crio-8cd986d0d7a072871dedea95b541a5daf093c3a91be296a71476e49f2a967a0e WatchSource:0}: Error finding container 8cd986d0d7a072871dedea95b541a5daf093c3a91be296a71476e49f2a967a0e: Status 404 returned error can't find the container with id 8cd986d0d7a072871dedea95b541a5daf093c3a91be296a71476e49f2a967a0e
Jul 06 11:29:59.182046 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.182010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd" event={"ID":"d6970189-9754-438a-92d2-32b4478e3acc","Type":"ContainerStarted","Data":"8cd986d0d7a072871dedea95b541a5daf093c3a91be296a71476e49f2a967a0e"}
Jul 06 11:29:59.245290 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.244915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"]
Jul 06 11:29:59.254670 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:59.254638    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb56472_2da3_44fc_b899_e9d00164cca3.slice/crio-637bff0414113df394e7df7337e78b98e78021a4967ebab7df52f797dfb12570 WatchSource:0}: Error finding container 637bff0414113df394e7df7337e78b98e78021a4967ebab7df52f797dfb12570: Status 404 returned error can't find the container with id 637bff0414113df394e7df7337e78b98e78021a4967ebab7df52f797dfb12570
Jul 06 11:29:59.273048 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.272985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:29:59.276995 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:59.276966    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4214d8f4_c635_4af1_8248_70e299236161.slice/crio-7ba007d676cddf4c07b5b38d190bdbd44a7615a5256dbce45e8b0ae27813ea97 WatchSource:0}: Error finding container 7ba007d676cddf4c07b5b38d190bdbd44a7615a5256dbce45e8b0ae27813ea97: Status 404 returned error can't find the container with id 7ba007d676cddf4c07b5b38d190bdbd44a7615a5256dbce45e8b0ae27813ea97
Jul 06 11:29:59.302345 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:29:59.302323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c74797bf4-mw8xb"]
Jul 06 11:29:59.304346 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:29:59.304320    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f3ecc1_7aed_47ae_8510_9c55bf693378.slice/crio-84f99f0502d88b390cafbab3ffc06b812f18aa67d06daf77a2406e6ce9cc308a WatchSource:0}: Error finding container 84f99f0502d88b390cafbab3ffc06b812f18aa67d06daf77a2406e6ce9cc308a: Status 404 returned error can't find the container with id 84f99f0502d88b390cafbab3ffc06b812f18aa67d06daf77a2406e6ce9cc308a
Jul 06 11:30:00.188402 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.188358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t" event={"ID":"9bb56472-2da3-44fc-b899-e9d00164cca3","Type":"ContainerStarted","Data":"637bff0414113df394e7df7337e78b98e78021a4967ebab7df52f797dfb12570"}
Jul 06 11:30:00.190072 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.190045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb" event={"ID":"64f3ecc1-7aed-47ae-8510-9c55bf693378","Type":"ContainerStarted","Data":"0b3fb95ddb97a6c76dcdc450c4d22f38ae9c9fdbf930d84ecea35cb4a968de02"}
Jul 06 11:30:00.190267 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.190090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb" event={"ID":"64f3ecc1-7aed-47ae-8510-9c55bf693378","Type":"ContainerStarted","Data":"84f99f0502d88b390cafbab3ffc06b812f18aa67d06daf77a2406e6ce9cc308a"}
Jul 06 11:30:00.190267 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.190170    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:30:00.191337 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.191314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8574fc974-nfwz4" event={"ID":"4214d8f4-c635-4af1-8248-70e299236161","Type":"ContainerStarted","Data":"7ba007d676cddf4c07b5b38d190bdbd44a7615a5256dbce45e8b0ae27813ea97"}
Jul 06 11:30:00.220893 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:00.220850    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb" podStartSLOduration=2.220833074 podStartE2EDuration="2.220833074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:00.220247941 +0000 UTC m=+76.931340471" watchObservedRunningTime="2026-07-06 11:30:00.220833074 +0000 UTC m=+76.931925601"
Jul 06 11:30:04.210235 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:04.210123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8574fc974-nfwz4" event={"ID":"4214d8f4-c635-4af1-8248-70e299236161","Type":"ContainerStarted","Data":"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"}
Jul 06 11:30:04.230176 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:04.230106    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8574fc974-nfwz4" podStartSLOduration=2.068454692 podStartE2EDuration="6.230088095s" totalImagesPullingTime="4.161633403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:04.229829697 +0000 UTC m=+80.940922229" watchObservedRunningTime="2026-07-06 11:30:04.230088095 +0000 UTC m=+80.941180625"
Jul 06 11:30:06.174120 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.174087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qfvb2"
Jul 06 11:30:06.220365 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.220328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t" event={"ID":"9bb56472-2da3-44fc-b899-e9d00164cca3","Type":"ContainerStarted","Data":"027fecb1ea6fe10b4b288d0c996ab87cb1287191e71ee1486c45eb98dc83d45c"}
Jul 06 11:30:06.220544 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.220489    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:30:06.223972 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.223895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxqtx" event={"ID":"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc","Type":"ContainerStarted","Data":"53cc1b12f24ea922b01f1851b154560e5fc318ebdc00a915d2f5ce08ef08e6ba"}
Jul 06 11:30:06.229684 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.229660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t"
Jul 06 11:30:06.230335 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.230285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd" event={"ID":"d6970189-9754-438a-92d2-32b4478e3acc","Type":"ContainerStarted","Data":"f6a97ab01575fe75bde407b40ded253dc27e6b4e593ad55a2d579c79019f6947"}
Jul 06 11:30:06.230574 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.230558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:30:06.232216 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.232126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd"
Jul 06 11:30:06.258763 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.258250    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-8nx4t" podStartSLOduration=1.92687246 podStartE2EDuration="8.258230993s" totalImagesPullingTime="6.331358533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:06.238948105 +0000 UTC m=+82.950040636" watchObservedRunningTime="2026-07-06 11:30:06.258230993 +0000 UTC m=+82.969323525"
Jul 06 11:30:06.280880 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.280836    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dc97b6844-hbhvd" podStartSLOduration=1.781041058 podStartE2EDuration="8.280819493s" totalImagesPullingTime="6.499778435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:06.27973092 +0000 UTC m=+82.990823452" watchObservedRunningTime="2026-07-06 11:30:06.280819493 +0000 UTC m=+82.991912023"
Jul 06 11:30:06.564520 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.564487    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"]
Jul 06 11:30:06.567787 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.567767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.571204 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.571182    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 11:30:06.571675 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.571657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tkdmx\""
Jul 06 11:30:06.571754 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.571744    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 11:30:06.572177 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.572163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 11:30:06.572332 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.572310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 11:30:06.572532 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.572509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 11:30:06.582634 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.582610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"]
Jul 06 11:30:06.652790 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.652760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.652918 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.652799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.652918 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.652825    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16791b27-27a9-4fb3-bbf4-0e846a603aa0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.652918 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.652848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjqpr\" (UniqueName: \"kubernetes.io/projected/16791b27-27a9-4fb3-bbf4-0e846a603aa0-kube-api-access-rjqpr\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.753693 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.753666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.753807 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.753697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.753807 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.753714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16791b27-27a9-4fb3-bbf4-0e846a603aa0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.753807 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.753730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjqpr\" (UniqueName: \"kubernetes.io/projected/16791b27-27a9-4fb3-bbf4-0e846a603aa0-kube-api-access-rjqpr\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.753968 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:30:06.753808    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 11:30:06.753968 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:30:06.753878    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls podName:16791b27-27a9-4fb3-bbf4-0e846a603aa0 nodeName:}" failed. No retries permitted until 2026-07-06 11:30:07.25386272 +0000 UTC m=+83.964955240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-sdxz2" (UID: "16791b27-27a9-4fb3-bbf4-0e846a603aa0") : secret "prometheus-operator-tls" not found
Jul 06 11:30:06.754524 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.754507    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16791b27-27a9-4fb3-bbf4-0e846a603aa0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.756124 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.756102    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:06.762108 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:06.762084    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjqpr\" (UniqueName: \"kubernetes.io/projected/16791b27-27a9-4fb3-bbf4-0e846a603aa0-kube-api-access-rjqpr\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:07.237312 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:07.237228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxqtx" event={"ID":"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc","Type":"ContainerStarted","Data":"d229d9b45a2c5e1fb3be39bdb7e894d72920610150e66ba3c8450ea30f2839bf"}
Jul 06 11:30:07.257730 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:07.257689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:07.260523 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:07.260492    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16791b27-27a9-4fb3-bbf4-0e846a603aa0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sdxz2\" (UID: \"16791b27-27a9-4fb3-bbf4-0e846a603aa0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:07.477167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:07.477119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"
Jul 06 11:30:07.630541 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:07.630507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2"]
Jul 06 11:30:07.634495 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:30:07.634468    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16791b27_27a9_4fb3_bbf4_0e846a603aa0.slice/crio-f724da8214e648dc4a0542b762d717bb5159e48394f37963b7d4635a1c0a0878 WatchSource:0}: Error finding container f724da8214e648dc4a0542b762d717bb5159e48394f37963b7d4635a1c0a0878: Status 404 returned error can't find the container with id f724da8214e648dc4a0542b762d717bb5159e48394f37963b7d4635a1c0a0878
Jul 06 11:30:08.242102 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:08.242059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2" event={"ID":"16791b27-27a9-4fb3-bbf4-0e846a603aa0","Type":"ContainerStarted","Data":"f724da8214e648dc4a0542b762d717bb5159e48394f37963b7d4635a1c0a0878"}
Jul 06 11:30:09.090285 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.090208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:09.090285 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.090282    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:09.095503 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.095458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:09.248680 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.248637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxqtx" event={"ID":"9c1659c4-3dbb-4036-bdd1-62177f5ff7dc","Type":"ContainerStarted","Data":"6902c4be3151b5b8a2d4afb4d84274d327def0d679b317674c8919f0c16850ce"}
Jul 06 11:30:09.253070 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.253044    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:09.267126 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:09.267072    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxqtx" podStartSLOduration=33.53815944 podStartE2EDuration="44.26705333s" totalImagesPullingTime="10.72889389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 11:29:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:09.266739904 +0000 UTC m=+85.977832436" watchObservedRunningTime="2026-07-06 11:30:09.26705333 +0000 UTC m=+85.978145861"
Jul 06 11:30:10.253819 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:10.253783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2" event={"ID":"16791b27-27a9-4fb3-bbf4-0e846a603aa0","Type":"ContainerStarted","Data":"48d92a6627ad180ad4dc864f7b99f6f23cec3b9053855be10333e7eacb508df0"}
Jul 06 11:30:10.254209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:10.253843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2" event={"ID":"16791b27-27a9-4fb3-bbf4-0e846a603aa0","Type":"ContainerStarted","Data":"ed85e71fadf397cce057b1463d615291055f207d5201eddb5454e53480e2bfe2"}
Jul 06 11:30:10.275825 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:10.275772    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sdxz2" podStartSLOduration=2.163165113 podStartE2EDuration="4.275755219s" totalImagesPullingTime="2.112590106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:10.273720122 +0000 UTC m=+86.984812662" watchObservedRunningTime="2026-07-06 11:30:10.275755219 +0000 UTC m=+86.986847750"
Jul 06 11:30:11.418793 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.418761    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:30:11.942198 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.942168    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6pql6"]
Jul 06 11:30:11.948537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.948517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:11.951805 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.951783    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 11:30:11.951902 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.951791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-85mzg\""
Jul 06 11:30:11.952304 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.952289    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 11:30:11.952367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:11.952350    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 11:30:12.099414 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-root\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099554 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099554 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-sys\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099554 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-metrics-client-ca\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099554 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-node-exporter-accelerators-collector-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099554 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-node-exporter-wtmp\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099721 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpwhm\" (UniqueName: \"kubernetes.io/projected/473c4572-96af-455e-8259-582aa62cb589-kube-api-access-zpwhm\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099721 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/473c4572-96af-455e-8259-582aa62cb589-node-exporter-textfile\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.099721 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.099615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-tls\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.200962 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-root\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.200962 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.200962 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-sys\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.200962 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-metrics-client-ca\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-node-exporter-accelerators-collector-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200986    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-root\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.200994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-node-exporter-wtmp\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpwhm\" (UniqueName: \"kubernetes.io/projected/473c4572-96af-455e-8259-582aa62cb589-kube-api-access-zpwhm\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201016    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-sys\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/473c4572-96af-455e-8259-582aa62cb589-node-exporter-wtmp\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/473c4572-96af-455e-8259-582aa62cb589-node-exporter-textfile\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201319 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-tls\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201702 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201518    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/473c4572-96af-455e-8259-582aa62cb589-node-exporter-textfile\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201767 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201743    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-metrics-client-ca\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.201821 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.201784    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/473c4572-96af-455e-8259-582aa62cb589-node-exporter-accelerators-collector-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.204034 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.204009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-tls\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.204174 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.204039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/473c4572-96af-455e-8259-582aa62cb589-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.211745 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.211719    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpwhm\" (UniqueName: \"kubernetes.io/projected/473c4572-96af-455e-8259-582aa62cb589-kube-api-access-zpwhm\") pod \"node-exporter-6pql6\" (UID: \"473c4572-96af-455e-8259-582aa62cb589\") " pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.257846 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:12.257815    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6pql6"
Jul 06 11:30:12.270401 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:30:12.270371    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473c4572_96af_455e_8259_582aa62cb589.slice/crio-eeb87e58092c8d53e5cb53e8d1266faffcad837da01229e891266117e1b2b9d2 WatchSource:0}: Error finding container eeb87e58092c8d53e5cb53e8d1266faffcad837da01229e891266117e1b2b9d2: Status 404 returned error can't find the container with id eeb87e58092c8d53e5cb53e8d1266faffcad837da01229e891266117e1b2b9d2
Jul 06 11:30:13.272028 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:13.271983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6pql6" event={"ID":"473c4572-96af-455e-8259-582aa62cb589","Type":"ContainerStarted","Data":"eeb87e58092c8d53e5cb53e8d1266faffcad837da01229e891266117e1b2b9d2"}
Jul 06 11:30:14.277396 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:14.277357    2581 generic.go:356] "Generic (PLEG): container finished" podID="473c4572-96af-455e-8259-582aa62cb589" containerID="ba38d40fa97a80f7a6000fe6d44f2bc3d0540db00ad775479d3a39ebad0df831" exitCode=0
Jul 06 11:30:14.277866 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:14.277418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6pql6" event={"ID":"473c4572-96af-455e-8259-582aa62cb589","Type":"ContainerDied","Data":"ba38d40fa97a80f7a6000fe6d44f2bc3d0540db00ad775479d3a39ebad0df831"}
Jul 06 11:30:15.282708 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:15.282674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6pql6" event={"ID":"473c4572-96af-455e-8259-582aa62cb589","Type":"ContainerStarted","Data":"e6cf2b14ec175d74bd472c2abc0d899f52df1b9170177a4efd8f4e4859b4a55f"}
Jul 06 11:30:15.283091 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:15.282724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6pql6" event={"ID":"473c4572-96af-455e-8259-582aa62cb589","Type":"ContainerStarted","Data":"b24df380c3d928a3a3a4effff9de8d3cc980d91ead8549d29b809ce03a2deb2c"}
Jul 06 11:30:15.304424 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:15.304374    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6pql6" podStartSLOduration=2.894870796 podStartE2EDuration="4.304358299s" totalImagesPullingTime="1.346768074s" totalInitContainerRuntime="62.719429ms" isStatefulPod=true podCreationTimestamp="2026-07-06 11:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:15.303471881 +0000 UTC m=+92.014564425" watchObservedRunningTime="2026-07-06 11:30:15.304358299 +0000 UTC m=+92.015450827"
Jul 06 11:30:16.723549 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.723515    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:30:16.727100 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.727071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.741516 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.741299    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 11:30:16.743888 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.743802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:30:16.836820 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.836968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.836968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.836968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.836968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.836968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.837158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.836997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrlnl\" (UniqueName: \"kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938084 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938247 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938462 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrlnl\" (UniqueName: \"kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.938914 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.939019 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.939019 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.938948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.939213 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.939195    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.941263 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.941230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.941339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.941310    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:16.947809 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:16.947789    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrlnl\" (UniqueName: \"kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl\") pod \"console-5c46fdb775-lrrww\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") " pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:17.037372 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:17.037350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:17.203765 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:17.203729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:30:17.207394 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:30:17.207370    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dd006a_a1bb_4b99_87d8_0add10b1cc2c.slice/crio-8a3e993129b73cb468c6e0ebc5ded3a40674213628145e63023485a50f9be257 WatchSource:0}: Error finding container 8a3e993129b73cb468c6e0ebc5ded3a40674213628145e63023485a50f9be257: Status 404 returned error can't find the container with id 8a3e993129b73cb468c6e0ebc5ded3a40674213628145e63023485a50f9be257
Jul 06 11:30:17.291741 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:17.291660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c46fdb775-lrrww" event={"ID":"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c","Type":"ContainerStarted","Data":"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"}
Jul 06 11:30:17.291741 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:17.291714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c46fdb775-lrrww" event={"ID":"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c","Type":"ContainerStarted","Data":"8a3e993129b73cb468c6e0ebc5ded3a40674213628145e63023485a50f9be257"}
Jul 06 11:30:17.350192 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:17.350042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c46fdb775-lrrww" podStartSLOduration=1.350022729 podStartE2EDuration="1.350022729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:17.349553513 +0000 UTC m=+94.060646068" watchObservedRunningTime="2026-07-06 11:30:17.350022729 +0000 UTC m=+94.061115258"
Jul 06 11:30:18.235995 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.235960    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:30:18.240504 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.240481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.243150 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 11:30:18.243284 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243200    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 11:30:18.243284 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 11:30:18.243284 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 11:30:18.243284 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243230    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 11:30:18.243467 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243340    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 11:30:18.243517 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 11:30:18.243609 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 11:30:18.243827 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243808    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 11:30:18.243945 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243840    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 11:30:18.243945 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243856    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8gfv9\""
Jul 06 11:30:18.243945 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 11:30:18.243945 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 11:30:18.244110 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243941    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 11:30:18.244110 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.243995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 11:30:18.244371 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.244347    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-femv1nskulcpv\""
Jul 06 11:30:18.247150 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.246694    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 11:30:18.259168 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.259130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:30:18.349433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.349611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kvh\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.350013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.349969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.450785 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.450785 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.450996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kvh\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451397 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.451876 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.451411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.452158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.452116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.452473 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.452448    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.453043 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.452728    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.453168 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.453066    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.453357 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.453335    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.454333 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.453756    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.454903 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.454085    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.455892 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.455863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457047    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457449 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457426    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457911 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457507    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.457911 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457862    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.458082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457921    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.458082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.457958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.458555 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.458522    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.459495 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.459473    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.460047 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.460024    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.460716 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.460697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kvh\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh\") pod \"prometheus-k8s-0\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.551995 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.551960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:18.712541 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:18.712505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:30:18.716024 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:30:18.715995    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943c2f1c_1be7_4b13_8259_2315b9ab1818.slice/crio-13f8e26f48531d1a3f799ee8c573786bd6ecc642c0ca7dcb0c4b41e6fdfb3f75 WatchSource:0}: Error finding container 13f8e26f48531d1a3f799ee8c573786bd6ecc642c0ca7dcb0c4b41e6fdfb3f75: Status 404 returned error can't find the container with id 13f8e26f48531d1a3f799ee8c573786bd6ecc642c0ca7dcb0c4b41e6fdfb3f75
Jul 06 11:30:19.300921 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:19.300882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"13f8e26f48531d1a3f799ee8c573786bd6ecc642c0ca7dcb0c4b41e6fdfb3f75"}
Jul 06 11:30:20.308455 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:20.308426    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b" exitCode=0
Jul 06 11:30:20.308741 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:20.308467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b"}
Jul 06 11:30:21.201027 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:21.200989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c74797bf4-mw8xb"
Jul 06 11:30:24.329970 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:24.329932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"}
Jul 06 11:30:24.330360 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:24.330014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"}
Jul 06 11:30:25.337358 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:25.337319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"}
Jul 06 11:30:25.337662 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:25.337405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"}
Jul 06 11:30:26.170967 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:26.170937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fq2w2"
Jul 06 11:30:26.343964 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:26.343933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"}
Jul 06 11:30:26.344356 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:26.343993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerStarted","Data":"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"}
Jul 06 11:30:26.379109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:26.379057    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.192332067 podStartE2EDuration="8.379037386s" totalImagesPullingTime="6.168691648s" totalInitContainerRuntime="18.013671ms" isStatefulPod=false podCreationTimestamp="2026-07-06 11:30:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:30:26.376899919 +0000 UTC m=+103.087992449" watchObservedRunningTime="2026-07-06 11:30:26.379037386 +0000 UTC m=+103.090129918"
Jul 06 11:30:27.037683 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:27.037643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:27.037887 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:27.037701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:27.042624 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:27.042602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:27.351254 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:27.351182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:30:28.552104 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:28.552068    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:30:36.445697 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.445654    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8574fc974-nfwz4" podUID="4214d8f4-c635-4af1-8248-70e299236161" containerName="console" containerID="cri-o://4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db" gracePeriod=15
Jul 06 11:30:36.746841 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.746815    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:36.804933 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.804907    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805113 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.804951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805113 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.804976    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805113 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.804998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805293 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.805123    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805293 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.805207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc5mx\" (UniqueName: \"kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx\") pod \"4214d8f4-c635-4af1-8248-70e299236161\" (UID: \"4214d8f4-c635-4af1-8248-70e299236161\") "
Jul 06 11:30:36.805430 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.805392    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca" (OuterVolumeSpecName: "service-ca") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:30:36.805500 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.805442    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:30:36.805596 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.805569    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config" (OuterVolumeSpecName: "console-config") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:30:36.807480 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.807450    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx" (OuterVolumeSpecName: "kube-api-access-sc5mx") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "kube-api-access-sc5mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:30:36.807580 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.807451    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:30:36.807580 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.807555    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4214d8f4-c635-4af1-8248-70e299236161" (UID: "4214d8f4-c635-4af1-8248-70e299236161"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:30:36.906225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906201    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-oauth-serving-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:36.906225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906220    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-oauth-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:36.906225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906230    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4214d8f4-c635-4af1-8248-70e299236161-console-serving-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:36.906394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906239    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-console-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:36.906394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906249    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc5mx\" (UniqueName: \"kubernetes.io/projected/4214d8f4-c635-4af1-8248-70e299236161-kube-api-access-sc5mx\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:36.906394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:36.906258    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4214d8f4-c635-4af1-8248-70e299236161-service-ca\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:30:37.385211 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.385176    2581 generic.go:356] "Generic (PLEG): container finished" podID="4214d8f4-c635-4af1-8248-70e299236161" containerID="4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db" exitCode=0
Jul 06 11:30:37.385401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.385219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8574fc974-nfwz4" event={"ID":"4214d8f4-c635-4af1-8248-70e299236161","Type":"ContainerDied","Data":"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"}
Jul 06 11:30:37.385401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.385262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8574fc974-nfwz4" event={"ID":"4214d8f4-c635-4af1-8248-70e299236161","Type":"ContainerDied","Data":"7ba007d676cddf4c07b5b38d190bdbd44a7615a5256dbce45e8b0ae27813ea97"}
Jul 06 11:30:37.385401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.385282    2581 scope.go:117] "RemoveContainer" containerID="4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"
Jul 06 11:30:37.385401 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.385223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8574fc974-nfwz4"
Jul 06 11:30:37.397342 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.397321    2581 scope.go:117] "RemoveContainer" containerID="4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"
Jul 06 11:30:37.397841 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:30:37.397810    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db\": container with ID starting with 4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db not found: ID does not exist" containerID="4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"
Jul 06 11:30:37.398063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.398010    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db"} err="failed to get container status \"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db\": rpc error: code = NotFound desc = could not find container \"4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db\": container with ID starting with 4b3e3b07723f42ee4e4197335d973abeb3b1f7fe89e8982952688a39d6b750db not found: ID does not exist"
Jul 06 11:30:37.419183 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.419156    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:30:37.435394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.435368    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8574fc974-nfwz4"]
Jul 06 11:30:37.826078 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:37.826044    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4214d8f4-c635-4af1-8248-70e299236161" path="/var/lib/kubelet/pods/4214d8f4-c635-4af1-8248-70e299236161/volumes"
Jul 06 11:30:40.674746 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:30:40.674708    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:31:05.694626 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:05.694567    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c46fdb775-lrrww" podUID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" containerName="console" containerID="cri-o://50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc" gracePeriod=15
Jul 06 11:31:05.939874 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:05.939850    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:31:06.035232 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrlnl\" (UniqueName: \"kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035290    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035322    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035536 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035536 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035536 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert\") pod \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\" (UID: \"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c\") "
Jul 06 11:31:06.035536 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035470    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:06.035735 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035673    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-service-ca\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.035735 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035694    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config" (OuterVolumeSpecName: "console-config") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:06.035859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035830    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:06.035919 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.035893    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:06.037418 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.037385    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:06.037537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.037493    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:06.037537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.037522    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl" (OuterVolumeSpecName: "kube-api-access-nrlnl") pod "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" (UID: "c2dd006a-a1bb-4b99-87d8-0add10b1cc2c"). InnerVolumeSpecName "kube-api-access-nrlnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:31:06.136566 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136531    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-oauth-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.136566 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136564    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-serving-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.136715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136577    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-oauth-serving-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.136715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136590    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrlnl\" (UniqueName: \"kubernetes.io/projected/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-kube-api-access-nrlnl\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.136715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136603    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-console-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.136715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.136616    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c-trusted-ca-bundle\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:06.503506 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.503472    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" containerID="50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc" exitCode=0
Jul 06 11:31:06.503669 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.503515    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c46fdb775-lrrww"
Jul 06 11:31:06.503669 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.503557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c46fdb775-lrrww" event={"ID":"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c","Type":"ContainerDied","Data":"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"}
Jul 06 11:31:06.503669 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.503608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c46fdb775-lrrww" event={"ID":"c2dd006a-a1bb-4b99-87d8-0add10b1cc2c","Type":"ContainerDied","Data":"8a3e993129b73cb468c6e0ebc5ded3a40674213628145e63023485a50f9be257"}
Jul 06 11:31:06.503669 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.503630    2581 scope.go:117] "RemoveContainer" containerID="50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"
Jul 06 11:31:06.511774 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.511758    2581 scope.go:117] "RemoveContainer" containerID="50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"
Jul 06 11:31:06.512021 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:06.512002    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc\": container with ID starting with 50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc not found: ID does not exist" containerID="50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"
Jul 06 11:31:06.512079 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.512027    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc"} err="failed to get container status \"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc\": rpc error: code = NotFound desc = could not find container \"50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc\": container with ID starting with 50f15f967fe58f183cf4148a4797c5cc9d4cf6b3db2056892c9e7cda2d3f25fc not found: ID does not exist"
Jul 06 11:31:06.525151 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.525115    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:31:06.527798 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:06.527771    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c46fdb775-lrrww"]
Jul 06 11:31:07.825770 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:07.825736    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" path="/var/lib/kubelet/pods/c2dd006a-a1bb-4b99-87d8-0add10b1cc2c/volumes"
Jul 06 11:31:18.552109 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:18.552075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:18.567218 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:18.567190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:19.571233 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:19.571207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:36.698692 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.698608    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:36.699568 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699533    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="prometheus" containerID="cri-o://7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963" gracePeriod=600
Jul 06 11:31:36.699688 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699539    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="config-reloader" containerID="cri-o://67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638" gracePeriod=600
Jul 06 11:31:36.699688 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699626    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-web" containerID="cri-o://93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5" gracePeriod=600
Jul 06 11:31:36.699843 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699560    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-thanos" containerID="cri-o://358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df" gracePeriod=600
Jul 06 11:31:36.699911 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699588    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy" containerID="cri-o://edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415" gracePeriod=600
Jul 06 11:31:36.700012 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:36.699558    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="thanos-sidecar" containerID="cri-o://8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33" gracePeriod=600
Jul 06 11:31:37.623936 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623899    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df" exitCode=0
Jul 06 11:31:37.623936 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623926    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415" exitCode=0
Jul 06 11:31:37.623936 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623933    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33" exitCode=0
Jul 06 11:31:37.623936 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623940    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638" exitCode=0
Jul 06 11:31:37.623936 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623946    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963" exitCode=0
Jul 06 11:31:37.624234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.623972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"}
Jul 06 11:31:37.624234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.624076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"}
Jul 06 11:31:37.624234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.624103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"}
Jul 06 11:31:37.624234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.624128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"}
Jul 06 11:31:37.624234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.624165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"}
Jul 06 11:31:37.949518 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.949492    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:37.986258 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986406 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986277    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986406 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986307    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986406 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986406 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986356    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986578    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986713 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986616    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986713 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986642    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986713 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986719    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.986859 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986848    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987097 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986809    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.987097 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987097 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.986996    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.987097 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987028    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.987097 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987043    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987107    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8kvh\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh\") pod \"943c2f1c-1be7-4b13-8259-2315b9ab1818\" (UID: \"943c2f1c-1be7-4b13-8259-2315b9ab1818\") "
Jul 06 11:31:37.987377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987267    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.987560 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987520    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.987560 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987541    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-metrics-client-ca\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:37.987656 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987562    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:37.987656 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987578    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:37.987656 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987593    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:37.988239 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.987966    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.989073 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.989047    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 11:31:37.989421 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.989395    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.989777 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.989736    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:31:37.990420 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.990382    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.991515 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.991478    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.991815 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.991778    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.992025 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.991992    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.992225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992184    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.992464 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh" (OuterVolumeSpecName: "kube-api-access-s8kvh") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "kube-api-access-s8kvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:31:37.992464 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.992638 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992517    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config" (OuterVolumeSpecName: "config") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:37.992824 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992802    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out" (OuterVolumeSpecName: "config-out") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 11:31:37.992915 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:37.992834    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:31:38.007913 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.007738    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config" (OuterVolumeSpecName: "web-config") pod "943c2f1c-1be7-4b13-8259-2315b9ab1818" (UID: "943c2f1c-1be7-4b13-8259-2315b9ab1818"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:31:38.088768 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088732    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-grpc-tls\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088768 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088766    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-tls-assets\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088768 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088775    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8kvh\" (UniqueName: \"kubernetes.io/projected/943c2f1c-1be7-4b13-8259-2315b9ab1818-kube-api-access-s8kvh\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088785    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088794    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-kube-rbac-proxy\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088803    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088812    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-config-out\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088820    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-web-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088828    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088836    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088845    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088853    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-secret-metrics-client-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088863    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088871    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-db\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088879    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/943c2f1c-1be7-4b13-8259-2315b9ab1818-config\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.088950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.088886    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/943c2f1c-1be7-4b13-8259-2315b9ab1818-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:31:38.630585 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.630544    2581 generic.go:356] "Generic (PLEG): container finished" podID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerID="93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5" exitCode=0
Jul 06 11:31:38.630751 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.630614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"}
Jul 06 11:31:38.630751 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.630639    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.630751 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.630683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"943c2f1c-1be7-4b13-8259-2315b9ab1818","Type":"ContainerDied","Data":"13f8e26f48531d1a3f799ee8c573786bd6ecc642c0ca7dcb0c4b41e6fdfb3f75"}
Jul 06 11:31:38.630751 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.630718    2581 scope.go:117] "RemoveContainer" containerID="358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"
Jul 06 11:31:38.638937 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.638916    2581 scope.go:117] "RemoveContainer" containerID="edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"
Jul 06 11:31:38.645773 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.645756    2581 scope.go:117] "RemoveContainer" containerID="93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"
Jul 06 11:31:38.652016 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.651999    2581 scope.go:117] "RemoveContainer" containerID="8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"
Jul 06 11:31:38.654937 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.654917    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:38.659648 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.659551    2581 scope.go:117] "RemoveContainer" containerID="67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"
Jul 06 11:31:38.659832 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.659813    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:38.666024 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.666008    2581 scope.go:117] "RemoveContainer" containerID="7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"
Jul 06 11:31:38.672567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.672551    2581 scope.go:117] "RemoveContainer" containerID="a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b"
Jul 06 11:31:38.678727 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.678711    2581 scope.go:117] "RemoveContainer" containerID="358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"
Jul 06 11:31:38.678989 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.678971    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df\": container with ID starting with 358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df not found: ID does not exist" containerID="358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"
Jul 06 11:31:38.679031 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.678998    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df"} err="failed to get container status \"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df\": rpc error: code = NotFound desc = could not find container \"358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df\": container with ID starting with 358aa590eb78d9ac718c4d5d6c946ffd2d355603671a0373d586ab9ccf8209df not found: ID does not exist"
Jul 06 11:31:38.679031 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679015    2581 scope.go:117] "RemoveContainer" containerID="edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"
Jul 06 11:31:38.679283 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.679264    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415\": container with ID starting with edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415 not found: ID does not exist" containerID="edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"
Jul 06 11:31:38.679337 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679290    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415"} err="failed to get container status \"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415\": rpc error: code = NotFound desc = could not find container \"edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415\": container with ID starting with edb12e4cc91758edd74a6379ae668de49834a011331948511156caa2531b8415 not found: ID does not exist"
Jul 06 11:31:38.679337 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679308    2581 scope.go:117] "RemoveContainer" containerID="93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"
Jul 06 11:31:38.679539 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.679521    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5\": container with ID starting with 93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5 not found: ID does not exist" containerID="93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"
Jul 06 11:31:38.679584 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5"} err="failed to get container status \"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5\": rpc error: code = NotFound desc = could not find container \"93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5\": container with ID starting with 93d1d1f51c799e9f853c7d2e1f7a1e8122732ed46a4c86a1a2d36c6614fd04a5 not found: ID does not exist"
Jul 06 11:31:38.679584 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679561    2581 scope.go:117] "RemoveContainer" containerID="8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"
Jul 06 11:31:38.679755 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.679740    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33\": container with ID starting with 8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33 not found: ID does not exist" containerID="8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"
Jul 06 11:31:38.679810 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679757    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33"} err="failed to get container status \"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33\": rpc error: code = NotFound desc = could not find container \"8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33\": container with ID starting with 8d65c597f6b59326ceaed2a697bd0187f613e0dec91e6a15db0037deaaa9ba33 not found: ID does not exist"
Jul 06 11:31:38.679810 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679770    2581 scope.go:117] "RemoveContainer" containerID="67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"
Jul 06 11:31:38.679957 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.679937    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638\": container with ID starting with 67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638 not found: ID does not exist" containerID="67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"
Jul 06 11:31:38.679997 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679963    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638"} err="failed to get container status \"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638\": rpc error: code = NotFound desc = could not find container \"67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638\": container with ID starting with 67eb28d916daabebb6e02e484bd36f61b7710c7a5d4657f166687f167f151638 not found: ID does not exist"
Jul 06 11:31:38.679997 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.679977    2581 scope.go:117] "RemoveContainer" containerID="7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"
Jul 06 11:31:38.680266 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.680249    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963\": container with ID starting with 7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963 not found: ID does not exist" containerID="7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"
Jul 06 11:31:38.680327 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.680269    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963"} err="failed to get container status \"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963\": rpc error: code = NotFound desc = could not find container \"7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963\": container with ID starting with 7ae5afcda806d5f88a4b28229fe8a35ad973281e80928eca224c54b767bc8963 not found: ID does not exist"
Jul 06 11:31:38.680327 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.680290    2581 scope.go:117] "RemoveContainer" containerID="a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b"
Jul 06 11:31:38.680518 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:31:38.680503    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b\": container with ID starting with a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b not found: ID does not exist" containerID="a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b"
Jul 06 11:31:38.680569 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.680520    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b"} err="failed to get container status \"a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b\": rpc error: code = NotFound desc = could not find container \"a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b\": container with ID starting with a0b369df7bc53698bd70fbb6d21ce5644801f41ef63c926aaab9de7f55eb685b not found: ID does not exist"
Jul 06 11:31:38.688036 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688014    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:38.688282 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="prometheus"
Jul 06 11:31:38.688282 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688283    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="prometheus"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688297    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-web"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688303    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-web"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688309    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688315    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688324    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-thanos"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688329    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-thanos"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688336    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="config-reloader"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688340    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="config-reloader"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688348    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" containerName="console"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688353    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" containerName="console"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688360    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="thanos-sidecar"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688365    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="thanos-sidecar"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688373    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4214d8f4-c635-4af1-8248-70e299236161" containerName="console"
Jul 06 11:31:38.688375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688379    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4214d8f4-c635-4af1-8248-70e299236161" containerName="console"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="init-config-reloader"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="init-config-reloader"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688431    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2dd006a-a1bb-4b99-87d8-0add10b1cc2c" containerName="console"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688437    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="config-reloader"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688444    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="thanos-sidecar"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688449    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="prometheus"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688455    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-web"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688461    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4214d8f4-c635-4af1-8248-70e299236161" containerName="console"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688466    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy"
Jul 06 11:31:38.688906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.688471    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" containerName="kube-rbac-proxy-thanos"
Jul 06 11:31:38.693690 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.693672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.695999 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.695982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 11:31:38.696086 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696065    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 11:31:38.696176 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696083    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 11:31:38.696176 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696095    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8gfv9\""
Jul 06 11:31:38.696402 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696381    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 11:31:38.696482 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 11:31:38.696482 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 11:31:38.696482 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696432    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-femv1nskulcpv\""
Jul 06 11:31:38.696482 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 11:31:38.696670 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 11:31:38.696718 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 11:31:38.696862 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.696846    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 11:31:38.697313 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.697296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 11:31:38.697501 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.697474    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 11:31:38.697617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.697506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 11:31:38.699707 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.699689    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 11:31:38.702267 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.702250    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 11:31:38.709940 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.709922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:38.793650 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793733 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793733 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793806 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793836 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793866 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793866 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.793925 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794015 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794015 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.793977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794078 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794078 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794078 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvphv\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-kube-api-access-nvphv\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794182 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.794296 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.794195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.894916 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.894847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.894916 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.894885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.894916 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.894903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.894921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895082 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895300 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895300 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895300 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895446 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895446 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895446 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895446 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvphv\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-kube-api-access-nvphv\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.895644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.896000 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.895976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.896193 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.896171    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.897169 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.897120    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.898099 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.897998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.898565 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.898248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.898565 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.898405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.898718 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.898699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.898883 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.898856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.899021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.898998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.899243 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.899219    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.899724 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.899702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.899822 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.899770    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.900021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.899966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.900392 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.900369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.900896 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.900866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.901168 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.901128    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.901288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.901272    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.901369 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.901349    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.901730 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.901711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:38.904493 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:38.904468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvphv\" (UniqueName: \"kubernetes.io/projected/decc6ce1-2226-4db5-89b8-f6f149c4bdbf-kube-api-access-nvphv\") pod \"prometheus-k8s-0\" (UID: \"decc6ce1-2226-4db5-89b8-f6f149c4bdbf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:39.003588 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.003556    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:31:39.142158 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.142106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 11:31:39.145036 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:31:39.144975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecc6ce1_2226_4db5_89b8_f6f149c4bdbf.slice/crio-f9edfaa2812abcadd173b6f1751f4f4a880913365fae2053bc9e6b172fb8c933 WatchSource:0}: Error finding container f9edfaa2812abcadd173b6f1751f4f4a880913365fae2053bc9e6b172fb8c933: Status 404 returned error can't find the container with id f9edfaa2812abcadd173b6f1751f4f4a880913365fae2053bc9e6b172fb8c933
Jul 06 11:31:39.636641 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.636604    2581 generic.go:356] "Generic (PLEG): container finished" podID="decc6ce1-2226-4db5-89b8-f6f149c4bdbf" containerID="52de51bcef91149dea782aedf016af5e64ec4ee7a10191f549f013c8597279d5" exitCode=0
Jul 06 11:31:39.636801 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.636663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerDied","Data":"52de51bcef91149dea782aedf016af5e64ec4ee7a10191f549f013c8597279d5"}
Jul 06 11:31:39.636801 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.636764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"f9edfaa2812abcadd173b6f1751f4f4a880913365fae2053bc9e6b172fb8c933"}
Jul 06 11:31:39.836173 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:39.835912    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="943c2f1c-1be7-4b13-8259-2315b9ab1818" path="/var/lib/kubelet/pods/943c2f1c-1be7-4b13-8259-2315b9ab1818/volumes"
Jul 06 11:31:40.643978 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.643938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"25b78c6d1b8a9957d6b389cc67fd4e876d0f0b61cd200defec933f609e3fabb7"}
Jul 06 11:31:40.644390 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.644000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"7528c2e59ce8063223752b47ee137ce42bab42a8f2d05f6981fab6990e7f9033"}
Jul 06 11:31:40.644390 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.644026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"1e55d60f71a1e0677d0613a95c70b7d685196f12e07e3750e42981a975d26761"}
Jul 06 11:31:40.644390 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.644052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"3c83256d2ed04aa18456f02542d8512d575811547b9bc697890f2c8d13071f22"}
Jul 06 11:31:40.644390 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.644075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"ea432cb0db71e0f367829a82a110093375ee1711d388585b2d34fdbd789c4f50"}
Jul 06 11:31:40.644390 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.644098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"decc6ce1-2226-4db5-89b8-f6f149c4bdbf","Type":"ContainerStarted","Data":"3e7a36f047187f1f67fdf82ed252fca87e570ab962199782ea12fc95a1714af2"}
Jul 06 11:31:40.673776 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:40.673722    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.655781024 podStartE2EDuration="2.673706949s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.925925ms" isStatefulPod=false podCreationTimestamp="2026-07-06 11:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:31:40.672160778 +0000 UTC m=+177.383253308" watchObservedRunningTime="2026-07-06 11:31:40.673706949 +0000 UTC m=+177.384799470"
Jul 06 11:31:44.004321 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:31:44.004297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:32:39.004288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:32:39.004251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:32:39.019362 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:32:39.019337    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:32:39.873666 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:32:39.873626    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 11:33:43.720287 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:33:43.720233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:33:43.721077 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:33:43.721058    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:33:43.724353 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:33:43.724326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:33:43.725035 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:33:43.725017    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:33:43.735252 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:33:43.735234    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 11:35:04.678824 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.678730    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"]
Jul 06 11:35:04.682311 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.682289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.685123 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.685097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 11:35:04.685123 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.685099    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 11:35:04.685411 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.685395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 11:35:04.685466 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.685437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 11:35:04.685512 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.685487    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmxtp\""
Jul 06 11:35:04.698962 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.698944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"]
Jul 06 11:35:04.856469 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.856435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-manifests\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.856632 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.856498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd5b6\" (UniqueName: \"kubernetes.io/projected/d9e53451-8dfe-4d61-8b62-ce5dfd998597-kube-api-access-xd5b6\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.856632 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.856539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.856632 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.856557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-tmp\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.856632 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.856593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.957631 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.957535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd5b6\" (UniqueName: \"kubernetes.io/projected/d9e53451-8dfe-4d61-8b62-ce5dfd998597-kube-api-access-xd5b6\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.957631 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.957588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.957631 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.957618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-tmp\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.957897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.957675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.957897 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.957710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-manifests\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.958104 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.958081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-manifests\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.959815 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.959794    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9e53451-8dfe-4d61-8b62-ce5dfd998597-tmp\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.960071 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.960049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.960130 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.960116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9e53451-8dfe-4d61-8b62-ce5dfd998597-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.966968 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.966945    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd5b6\" (UniqueName: \"kubernetes.io/projected/d9e53451-8dfe-4d61-8b62-ce5dfd998597-kube-api-access-xd5b6\") pod \"opendatahub-operator-controller-manager-6cb7946974-h4ksh\" (UID: \"d9e53451-8dfe-4d61-8b62-ce5dfd998597\") " pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:04.995985 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:04.995962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:05.134698 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:05.134669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"]
Jul 06 11:35:05.136430 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:35:05.136406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e53451_8dfe_4d61_8b62_ce5dfd998597.slice/crio-2bf579029b328ce2cd22803203f4b39f03843eda0c3c4b828130bd4362e7bf2f WatchSource:0}: Error finding container 2bf579029b328ce2cd22803203f4b39f03843eda0c3c4b828130bd4362e7bf2f: Status 404 returned error can't find the container with id 2bf579029b328ce2cd22803203f4b39f03843eda0c3c4b828130bd4362e7bf2f
Jul 06 11:35:05.138827 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:05.138811    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 11:35:05.363229 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:05.363192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh" event={"ID":"d9e53451-8dfe-4d61-8b62-ce5dfd998597","Type":"ContainerStarted","Data":"2bf579029b328ce2cd22803203f4b39f03843eda0c3c4b828130bd4362e7bf2f"}
Jul 06 11:35:09.381017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:09.380982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh" event={"ID":"d9e53451-8dfe-4d61-8b62-ce5dfd998597","Type":"ContainerStarted","Data":"c0239580106cfe55d3a1e397d911da62d0bd3817c26e5bb695af49d70a726fe2"}
Jul 06 11:35:10.386379 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:10.386344    2581 generic.go:356] "Generic (PLEG): container finished" podID="d9e53451-8dfe-4d61-8b62-ce5dfd998597" containerID="c0239580106cfe55d3a1e397d911da62d0bd3817c26e5bb695af49d70a726fe2" exitCode=0
Jul 06 11:35:10.386748 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:10.386391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh" event={"ID":"d9e53451-8dfe-4d61-8b62-ce5dfd998597","Type":"ContainerDied","Data":"c0239580106cfe55d3a1e397d911da62d0bd3817c26e5bb695af49d70a726fe2"}
Jul 06 11:35:12.395147 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:12.395110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh" event={"ID":"d9e53451-8dfe-4d61-8b62-ce5dfd998597","Type":"ContainerStarted","Data":"5bbcfaf9b85410f5b2d24de844727e2b92ee7724165a3d36c2ded8e1a608350a"}
Jul 06 11:35:12.395509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:12.395309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:12.417713 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:12.417668    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh" podStartSLOduration=3.209787194 podStartE2EDuration="8.417651923s" totalImagesPullingTime="4.180598952s" totalInitContainerRuntime="1.027265777s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:35:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:35:12.417061039 +0000 UTC m=+389.128153593" watchObservedRunningTime="2026-07-06 11:35:12.417651923 +0000 UTC m=+389.128744444"
Jul 06 11:35:23.401470 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:23.401440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cb7946974-h4ksh"
Jul 06 11:35:30.022834 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.022803    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:30.033700 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.033678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.035734 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.035706    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 11:35:30.035976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.035945    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 11:35:30.036087 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.036073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 11:35:30.036180 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.036100    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kmcbr\""
Jul 06 11:35:30.036295 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.036270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 11:35:30.036916 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.036894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:30.156358 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156358 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwv4v\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.156613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.156583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257054 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257054 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257270 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257270 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257270 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257270 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257270 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwv4v\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.257810 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.257780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.259365 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.259341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.259611 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.259593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.259686 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.259643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.259686 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.259672    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.265081 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.265056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.265592 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.265572    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwv4v\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v\") pod \"istiod-openshift-gateway-7574459656-k49dm\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.344179 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.344082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:30.498872 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:30.498844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:30.501342 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:35:30.501316    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode435db1f_9e67_48df_a36c_b2d42eb979e8.slice/crio-b9762358629d1f50f56f8717b45325a4e20e21e524fe28eb61dc2d272d740a4c WatchSource:0}: Error finding container b9762358629d1f50f56f8717b45325a4e20e21e524fe28eb61dc2d272d740a4c: Status 404 returned error can't find the container with id b9762358629d1f50f56f8717b45325a4e20e21e524fe28eb61dc2d272d740a4c
Jul 06 11:35:31.466843 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.466811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" event={"ID":"e435db1f-9e67-48df-a36c-b2d42eb979e8","Type":"ContainerStarted","Data":"b9762358629d1f50f56f8717b45325a4e20e21e524fe28eb61dc2d272d740a4c"}
Jul 06 11:35:31.668861 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.668831    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"]
Jul 06 11:35:31.671884 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.671865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.674096 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.674074    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 11:35:31.674967 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.674940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 11:35:31.674967 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.674951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rcfnq\""
Jul 06 11:35:31.675151 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.675002    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 11:35:31.675151 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.675012    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 11:35:31.675304 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.675290    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 11:35:31.680699 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.680672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"]
Jul 06 11:35:31.767853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.767738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416cf0ec-7471-42d5-bfa6-de4b69be8efd-manager-config\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.767853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.767783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-metrics-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.767853 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.767829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqxkv\" (UniqueName: \"kubernetes.io/projected/416cf0ec-7471-42d5-bfa6-de4b69be8efd-kube-api-access-xqxkv\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.768151 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.767956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.869209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.868785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.869209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.868851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416cf0ec-7471-42d5-bfa6-de4b69be8efd-manager-config\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.869209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.868885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-metrics-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.869209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.868932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxkv\" (UniqueName: \"kubernetes.io/projected/416cf0ec-7471-42d5-bfa6-de4b69be8efd-kube-api-access-xqxkv\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.869882 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.869831    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416cf0ec-7471-42d5-bfa6-de4b69be8efd-manager-config\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.871816 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.871793    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.872225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.872178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416cf0ec-7471-42d5-bfa6-de4b69be8efd-metrics-cert\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.877291 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.877258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxkv\" (UniqueName: \"kubernetes.io/projected/416cf0ec-7471-42d5-bfa6-de4b69be8efd-kube-api-access-xqxkv\") pod \"lws-controller-manager-758cc6698f-bnqdv\" (UID: \"416cf0ec-7471-42d5-bfa6-de4b69be8efd\") " pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:31.982462 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:31.982427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:32.128013 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:32.127981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"]
Jul 06 11:35:32.132065 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:35:32.131999    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416cf0ec_7471_42d5_bfa6_de4b69be8efd.slice/crio-faa03503f462f19d95e376fb9082d785f643fd42c01dbdc5367efbd4743b0278 WatchSource:0}: Error finding container faa03503f462f19d95e376fb9082d785f643fd42c01dbdc5367efbd4743b0278: Status 404 returned error can't find the container with id faa03503f462f19d95e376fb9082d785f643fd42c01dbdc5367efbd4743b0278
Jul 06 11:35:32.472860 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:32.472772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv" event={"ID":"416cf0ec-7471-42d5-bfa6-de4b69be8efd","Type":"ContainerStarted","Data":"faa03503f462f19d95e376fb9082d785f643fd42c01dbdc5367efbd4743b0278"}
Jul 06 11:35:33.571427 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:33.571379    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:35:33.571763 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:33.571457    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:35:34.488287 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:34.488175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" event={"ID":"e435db1f-9e67-48df-a36c-b2d42eb979e8","Type":"ContainerStarted","Data":"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"}
Jul 06 11:35:34.489533 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:34.489402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:34.490446 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:34.490410    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k49dm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 11:35:34.490570 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:34.490480    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 11:35:34.522176 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:34.522099    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" podStartSLOduration=1.4540037909999999 podStartE2EDuration="4.522080555s" totalImagesPullingTime="3.068076764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:35:34.521038736 +0000 UTC m=+411.232131267" watchObservedRunningTime="2026-07-06 11:35:34.522080555 +0000 UTC m=+411.233173088"
Jul 06 11:35:35.494190 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:35.494151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv" event={"ID":"416cf0ec-7471-42d5-bfa6-de4b69be8efd","Type":"ContainerStarted","Data":"b4a1854346f0ed8ad758e5bac932b086d85051af684694d75d0453cf54b5116a"}
Jul 06 11:35:35.494907 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:35.494889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:35.512640 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:35.512587    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv" podStartSLOduration=1.284541554 podStartE2EDuration="4.512568569s" totalImagesPullingTime="3.228027015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:35:35.511981579 +0000 UTC m=+412.223074109" watchObservedRunningTime="2026-07-06 11:35:35.512568569 +0000 UTC m=+412.223661100"
Jul 06 11:35:36.499148 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:36.499118    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:35:38.863987 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:38.863951    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:38.864454 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:38.864146    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerName="discovery" containerID="cri-o://950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57" gracePeriod=30
Jul 06 11:35:39.106229 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.106206    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:39.232088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232022    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwv4v\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232271 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232271 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232120    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232271 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232174    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232271 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232271 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232247    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert\") pod \"e435db1f-9e67-48df-a36c-b2d42eb979e8\" (UID: \"e435db1f-9e67-48df-a36c-b2d42eb979e8\") "
Jul 06 11:35:39.232593 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.232543    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:35:39.234463 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234434    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:35:39.234575 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234463    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs" (OuterVolumeSpecName: "local-certs") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 11:35:39.234686 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234667    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v" (OuterVolumeSpecName: "kube-api-access-nwv4v") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "kube-api-access-nwv4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:35:39.234784 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234688    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts" (OuterVolumeSpecName: "cacerts") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:35:39.234784 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:35:39.234851 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.234784    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e435db1f-9e67-48df-a36c-b2d42eb979e8" (UID: "e435db1f-9e67-48df-a36c-b2d42eb979e8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 11:35:39.333192 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333173    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-cacerts\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333192 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333194    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-dns-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333203    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e435db1f-9e67-48df-a36c-b2d42eb979e8-local-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333212    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwv4v\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-kube-api-access-nwv4v\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333223    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-kubeconfig\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333236    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-csr-ca-configmap\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.333329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.333245    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e435db1f-9e67-48df-a36c-b2d42eb979e8-istio-token\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:35:39.511415 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.511387    2581 generic.go:356] "Generic (PLEG): container finished" podID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerID="950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57" exitCode=0
Jul 06 11:35:39.511558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.511431    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"
Jul 06 11:35:39.511558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.511478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" event={"ID":"e435db1f-9e67-48df-a36c-b2d42eb979e8","Type":"ContainerDied","Data":"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"}
Jul 06 11:35:39.511558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.511527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k49dm" event={"ID":"e435db1f-9e67-48df-a36c-b2d42eb979e8","Type":"ContainerDied","Data":"b9762358629d1f50f56f8717b45325a4e20e21e524fe28eb61dc2d272d740a4c"}
Jul 06 11:35:39.511558 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.511548    2581 scope.go:117] "RemoveContainer" containerID="950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"
Jul 06 11:35:39.520370 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.520349    2581 scope.go:117] "RemoveContainer" containerID="950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"
Jul 06 11:35:39.520609 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:35:39.520591    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57\": container with ID starting with 950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57 not found: ID does not exist" containerID="950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"
Jul 06 11:35:39.520654 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.520618    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57"} err="failed to get container status \"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57\": rpc error: code = NotFound desc = could not find container \"950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57\": container with ID starting with 950e4f97de006bc8427c688c0a151cd90afcd6f8fd7c76f40449ed404ad44c57 not found: ID does not exist"
Jul 06 11:35:39.533567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.533548    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:39.538746 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.538727    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k49dm"]
Jul 06 11:35:39.825882 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:39.825807    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" path="/var/lib/kubelet/pods/e435db1f-9e67-48df-a36c-b2d42eb979e8/volumes"
Jul 06 11:35:47.505116 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:35:47.505083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758cc6698f-bnqdv"
Jul 06 11:36:26.713366 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.713332    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:26.713805 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.713609    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerName="discovery"
Jul 06 11:36:26.713805 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.713618    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerName="discovery"
Jul 06 11:36:26.713805 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.713674    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e435db1f-9e67-48df-a36c-b2d42eb979e8" containerName="discovery"
Jul 06 11:36:26.715504 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.715487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:26.718277 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.718253    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 11:36:26.718494 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.718286    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 11:36:26.718588 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.718311    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lqg4h\""
Jul 06 11:36:26.726883 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.726860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:26.805995 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.805971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s6nf\" (UniqueName: \"kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf\") pod \"kuadrant-operator-catalog-gmj6v\" (UID: \"873f4aff-85ac-48b8-9879-1e2c0aa4f98b\") " pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:26.906345 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.906312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s6nf\" (UniqueName: \"kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf\") pod \"kuadrant-operator-catalog-gmj6v\" (UID: \"873f4aff-85ac-48b8-9879-1e2c0aa4f98b\") " pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:26.914424 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:26.914402    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s6nf\" (UniqueName: \"kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf\") pod \"kuadrant-operator-catalog-gmj6v\" (UID: \"873f4aff-85ac-48b8-9879-1e2c0aa4f98b\") " pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:27.028415 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.028391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:27.072034 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.072002    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:27.151836 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.151812    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:27.154537 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:36:27.154507    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873f4aff_85ac_48b8_9879_1e2c0aa4f98b.slice/crio-5adb95393262372ccf79cd2081ff3e39a7c7deb1f3718e0701de9ef645695efc WatchSource:0}: Error finding container 5adb95393262372ccf79cd2081ff3e39a7c7deb1f3718e0701de9ef645695efc: Status 404 returned error can't find the container with id 5adb95393262372ccf79cd2081ff3e39a7c7deb1f3718e0701de9ef645695efc
Jul 06 11:36:27.288894 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.288811    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t88w"]
Jul 06 11:36:27.291288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.291272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:27.300745 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.300724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t88w"]
Jul 06 11:36:27.411652 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.411621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwz5\" (UniqueName: \"kubernetes.io/projected/7f462938-b20a-4eb6-91a8-dd2810fa6ca0-kube-api-access-bkwz5\") pod \"kuadrant-operator-catalog-8t88w\" (UID: \"7f462938-b20a-4eb6-91a8-dd2810fa6ca0\") " pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:27.512978 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.512951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwz5\" (UniqueName: \"kubernetes.io/projected/7f462938-b20a-4eb6-91a8-dd2810fa6ca0-kube-api-access-bkwz5\") pod \"kuadrant-operator-catalog-8t88w\" (UID: \"7f462938-b20a-4eb6-91a8-dd2810fa6ca0\") " pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:27.522028 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.521994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwz5\" (UniqueName: \"kubernetes.io/projected/7f462938-b20a-4eb6-91a8-dd2810fa6ca0-kube-api-access-bkwz5\") pod \"kuadrant-operator-catalog-8t88w\" (UID: \"7f462938-b20a-4eb6-91a8-dd2810fa6ca0\") " pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:27.601028 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.600969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:27.701988 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.701897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" event={"ID":"873f4aff-85ac-48b8-9879-1e2c0aa4f98b","Type":"ContainerStarted","Data":"5adb95393262372ccf79cd2081ff3e39a7c7deb1f3718e0701de9ef645695efc"}
Jul 06 11:36:27.734475 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:27.734446    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8t88w"]
Jul 06 11:36:27.737632 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:36:27.737601    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f462938_b20a_4eb6_91a8_dd2810fa6ca0.slice/crio-cc2466e9692138b9ec6d312b3229b9fd14c4b0b4e59ab06cca8ea9707dc7712a WatchSource:0}: Error finding container cc2466e9692138b9ec6d312b3229b9fd14c4b0b4e59ab06cca8ea9707dc7712a: Status 404 returned error can't find the container with id cc2466e9692138b9ec6d312b3229b9fd14c4b0b4e59ab06cca8ea9707dc7712a
Jul 06 11:36:28.708563 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:28.708524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8t88w" event={"ID":"7f462938-b20a-4eb6-91a8-dd2810fa6ca0","Type":"ContainerStarted","Data":"cc2466e9692138b9ec6d312b3229b9fd14c4b0b4e59ab06cca8ea9707dc7712a"}
Jul 06 11:36:29.714490 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.714453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8t88w" event={"ID":"7f462938-b20a-4eb6-91a8-dd2810fa6ca0","Type":"ContainerStarted","Data":"5f4a9160b0e285e50e34bf637ff72f241b39b6a296388d52329fc20fc51040c3"}
Jul 06 11:36:29.715845 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.715808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" event={"ID":"873f4aff-85ac-48b8-9879-1e2c0aa4f98b","Type":"ContainerStarted","Data":"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"}
Jul 06 11:36:29.715991 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.715880    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" podUID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" containerName="registry-server" containerID="cri-o://e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279" gracePeriod=2
Jul 06 11:36:29.738691 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.738652    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8t88w" podStartSLOduration=1.304234508 podStartE2EDuration="2.738638305s" totalImagesPullingTime="1.434403797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:36:29.737592171 +0000 UTC m=+466.448684714" watchObservedRunningTime="2026-07-06 11:36:29.738638305 +0000 UTC m=+466.449730834"
Jul 06 11:36:29.756519 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.756474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" podStartSLOduration=1.7418459670000002 podStartE2EDuration="3.756460813s" totalImagesPullingTime="2.014614846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:36:29.754190855 +0000 UTC m=+466.465283385" watchObservedRunningTime="2026-07-06 11:36:29.756460813 +0000 UTC m=+466.467553361"
Jul 06 11:36:29.961754 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:29.961727    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:30.033259 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.033230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s6nf\" (UniqueName: \"kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf\") pod \"873f4aff-85ac-48b8-9879-1e2c0aa4f98b\" (UID: \"873f4aff-85ac-48b8-9879-1e2c0aa4f98b\") "
Jul 06 11:36:30.035263 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.035243    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf" (OuterVolumeSpecName: "kube-api-access-7s6nf") pod "873f4aff-85ac-48b8-9879-1e2c0aa4f98b" (UID: "873f4aff-85ac-48b8-9879-1e2c0aa4f98b"). InnerVolumeSpecName "kube-api-access-7s6nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:36:30.133904 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.133870    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s6nf\" (UniqueName: \"kubernetes.io/projected/873f4aff-85ac-48b8-9879-1e2c0aa4f98b-kube-api-access-7s6nf\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:36:30.720791 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.720758    2581 generic.go:356] "Generic (PLEG): container finished" podID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" containerID="e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279" exitCode=0
Jul 06 11:36:30.721184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.720801    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v"
Jul 06 11:36:30.721184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.720843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" event={"ID":"873f4aff-85ac-48b8-9879-1e2c0aa4f98b","Type":"ContainerDied","Data":"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"}
Jul 06 11:36:30.721184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.720892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gmj6v" event={"ID":"873f4aff-85ac-48b8-9879-1e2c0aa4f98b","Type":"ContainerDied","Data":"5adb95393262372ccf79cd2081ff3e39a7c7deb1f3718e0701de9ef645695efc"}
Jul 06 11:36:30.721184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.720913    2581 scope.go:117] "RemoveContainer" containerID="e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"
Jul 06 11:36:30.729485 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.729469    2581 scope.go:117] "RemoveContainer" containerID="e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"
Jul 06 11:36:30.729736 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:36:30.729718    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279\": container with ID starting with e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279 not found: ID does not exist" containerID="e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"
Jul 06 11:36:30.729799 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.729769    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279"} err="failed to get container status \"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279\": rpc error: code = NotFound desc = could not find container \"e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279\": container with ID starting with e1fb62e2410ab58f825b6da6bedcc687e0831d54103b5205aeed8031571ed279 not found: ID does not exist"
Jul 06 11:36:30.742776 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.742757    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:30.747161 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:30.747129    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gmj6v"]
Jul 06 11:36:31.825188 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:31.825155    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" path="/var/lib/kubelet/pods/873f4aff-85ac-48b8-9879-1e2c0aa4f98b/volumes"
Jul 06 11:36:37.601645 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:37.601611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:37.602108 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:37.601684    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:37.624017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:37.623997    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:36:37.769464 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:36:37.769440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8t88w"
Jul 06 11:37:00.428015 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.427975    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"]
Jul 06 11:37:00.428509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.428375    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" containerName="registry-server"
Jul 06 11:37:00.428509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.428390    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" containerName="registry-server"
Jul 06 11:37:00.428509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.428440    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="873f4aff-85ac-48b8-9879-1e2c0aa4f98b" containerName="registry-server"
Jul 06 11:37:00.434885 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.434867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.437265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.437240    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qlxfr\""
Jul 06 11:37:00.445556 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.445537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"]
Jul 06 11:37:00.575225 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.575174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstgv\" (UniqueName: \"kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.575453 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.575260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.676200 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.676172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.676367 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.676228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstgv\" (UniqueName: \"kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.676614 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.676593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.687644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.687593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstgv\" (UniqueName: \"kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.744951 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.744914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:00.882548 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:00.882511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"]
Jul 06 11:37:00.885753 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:00.885723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d0446f_2118_4282_b62f_d7a8ce81ea6c.slice/crio-4c8aa89cc11d581b79213759da9e52ef5011041e1b305a0125a2546f070c6812 WatchSource:0}: Error finding container 4c8aa89cc11d581b79213759da9e52ef5011041e1b305a0125a2546f070c6812: Status 404 returned error can't find the container with id 4c8aa89cc11d581b79213759da9e52ef5011041e1b305a0125a2546f070c6812
Jul 06 11:37:01.844302 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:01.844265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5" event={"ID":"97d0446f-2118-4282-b62f-d7a8ce81ea6c","Type":"ContainerStarted","Data":"4c8aa89cc11d581b79213759da9e52ef5011041e1b305a0125a2546f070c6812"}
Jul 06 11:37:03.496064 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.496029    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"]
Jul 06 11:37:03.498884 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.498869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:03.500907 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.499874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftt8x\" (UniqueName: \"kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x\") pod \"limitador-operator-controller-manager-859d7b78bd-pldkr\" (UID: \"247e83ac-2378-4743-8753-c1eb9958a24e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:03.501524 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.501502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-b2nx5\""
Jul 06 11:37:03.512373 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.512347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"]
Jul 06 11:37:03.600620 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.600579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftt8x\" (UniqueName: \"kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x\") pod \"limitador-operator-controller-manager-859d7b78bd-pldkr\" (UID: \"247e83ac-2378-4743-8753-c1eb9958a24e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:03.609771 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.609746    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftt8x\" (UniqueName: \"kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x\") pod \"limitador-operator-controller-manager-859d7b78bd-pldkr\" (UID: \"247e83ac-2378-4743-8753-c1eb9958a24e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:03.814762 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.814730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:03.965941 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:03.965780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"]
Jul 06 11:37:03.967975 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:03.967949    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247e83ac_2378_4743_8753_c1eb9958a24e.slice/crio-998978ffebf8e93f4227276032f87f4b0226a0eb570c36fcb9c2e849a67b8239 WatchSource:0}: Error finding container 998978ffebf8e93f4227276032f87f4b0226a0eb570c36fcb9c2e849a67b8239: Status 404 returned error can't find the container with id 998978ffebf8e93f4227276032f87f4b0226a0eb570c36fcb9c2e849a67b8239
Jul 06 11:37:04.859255 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:04.859219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr" event={"ID":"247e83ac-2378-4743-8753-c1eb9958a24e","Type":"ContainerStarted","Data":"998978ffebf8e93f4227276032f87f4b0226a0eb570c36fcb9c2e849a67b8239"}
Jul 06 11:37:05.865196 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:05.865156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5" event={"ID":"97d0446f-2118-4282-b62f-d7a8ce81ea6c","Type":"ContainerStarted","Data":"19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3"}
Jul 06 11:37:05.865644 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:05.865301    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:05.892445 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:05.892404    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5" podStartSLOduration=1.2679633940000001 podStartE2EDuration="5.892389912s" totalImagesPullingTime="4.624426518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:05.890560685 +0000 UTC m=+502.601665127" watchObservedRunningTime="2026-07-06 11:37:05.892389912 +0000 UTC m=+502.603482492"
Jul 06 11:37:06.876641 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:06.876602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr" event={"ID":"247e83ac-2378-4743-8753-c1eb9958a24e","Type":"ContainerStarted","Data":"0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d"}
Jul 06 11:37:06.877030 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:06.876841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:06.897736 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:06.897692    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr" podStartSLOduration=1.527998893 podStartE2EDuration="3.897679679s" totalImagesPullingTime="2.369680786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:06.896274887 +0000 UTC m=+503.607367417" watchObservedRunningTime="2026-07-06 11:37:06.897679679 +0000 UTC m=+503.608772208"
Jul 06 11:37:08.750218 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.750187    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"]
Jul 06 11:37:08.753316 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.753294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.755310 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.755281    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 11:37:08.755409 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.755388    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 11:37:08.755476 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.755414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sk7l8\""
Jul 06 11:37:08.761619 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.761598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"]
Jul 06 11:37:08.842023 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.841991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.842220 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.842033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.842220 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.842063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjsv\" (UniqueName: \"kubernetes.io/projected/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-kube-api-access-fxjsv\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.943496 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.943462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.943638 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.943504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjsv\" (UniqueName: \"kubernetes.io/projected/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-kube-api-access-fxjsv\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.943638 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.943584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.943638 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:08.943616    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 11:37:08.943749 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:08.943697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert podName:c28b1ee8-78b4-4667-ae04-151c3b38ee5f nodeName:}" failed. No retries permitted until 2026-07-06 11:37:09.443673755 +0000 UTC m=+506.154766271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9krkg" (UID: "c28b1ee8-78b4-4667-ae04-151c3b38ee5f") : secret "plugin-serving-cert" not found
Jul 06 11:37:08.944222 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.944205    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:08.954848 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:08.954821    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjsv\" (UniqueName: \"kubernetes.io/projected/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-kube-api-access-fxjsv\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:09.447992 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:09.447952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:09.450339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:09.450317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c28b1ee8-78b4-4667-ae04-151c3b38ee5f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9krkg\" (UID: \"c28b1ee8-78b4-4667-ae04-151c3b38ee5f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:09.672814 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:09.672780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"
Jul 06 11:37:09.799061 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:09.799024    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg"]
Jul 06 11:37:09.803277 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:09.803247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc28b1ee8_78b4_4667_ae04_151c3b38ee5f.slice/crio-8d91788d7f2317480c7c947be75d0a3a2402eb28a698445f9531df0ef26b3c2d WatchSource:0}: Error finding container 8d91788d7f2317480c7c947be75d0a3a2402eb28a698445f9531df0ef26b3c2d: Status 404 returned error can't find the container with id 8d91788d7f2317480c7c947be75d0a3a2402eb28a698445f9531df0ef26b3c2d
Jul 06 11:37:09.890187 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:09.890157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg" event={"ID":"c28b1ee8-78b4-4667-ae04-151c3b38ee5f","Type":"ContainerStarted","Data":"8d91788d7f2317480c7c947be75d0a3a2402eb28a698445f9531df0ef26b3c2d"}
Jul 06 11:37:16.879310 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:16.879281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:17.883479 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:17.883450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:18.830602 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.830570    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"]
Jul 06 11:37:18.830795 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.830747    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" containerName="manager" containerID="cri-o://19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3" gracePeriod=2
Jul 06 11:37:18.841279 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.841004    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"]
Jul 06 11:37:18.841934 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.841887    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"97d0446f-2118-4282-b62f-d7a8ce81ea6c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\": pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:18.853340 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.853298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"]
Jul 06 11:37:18.853738 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.853515    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" containerName="manager" containerID="cri-o://0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d" gracePeriod=2
Jul 06 11:37:18.855853 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.855629    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:18.862157 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.857863    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:18.862157 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.858910    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" containerName="manager"
Jul 06 11:37:18.862157 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.858929    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" containerName="manager"
Jul 06 11:37:18.862157 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.859209    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" containerName="manager"
Jul 06 11:37:18.868186 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.867832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:18.873678 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.873640    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"]
Jul 06 11:37:18.875503 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.875481    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:18.892051 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.892008    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"247e83ac-2378-4743-8753-c1eb9958a24e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-pldkr\": pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:18.893943 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.893894    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:18.897266 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.897241    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"]
Jul 06 11:37:18.897679 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.897660    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" containerName="manager"
Jul 06 11:37:18.897753 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.897683    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" containerName="manager"
Jul 06 11:37:18.897805 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.897786    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" containerName="manager"
Jul 06 11:37:18.902214 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.902192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:18.930728 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.930691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgfj\" (UniqueName: \"kubernetes.io/projected/843ef1db-219d-4669-811e-8ae5a06568de-kube-api-access-ppgfj\") pod \"limitador-operator-controller-manager-859d7b78bd-4k7jz\" (UID: \"843ef1db-219d-4669-811e-8ae5a06568de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:18.930875 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.930764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4njt\" (UniqueName: \"kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:18.930875 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.930794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:18.942787 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:18.942761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"]
Jul 06 11:37:18.943163 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.943079    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:18.991723 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.991682    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:18.994766 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:18.994739    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:19.031883 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.031857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4njt\" (UniqueName: \"kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:19.032020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.031901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:19.032020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.031988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgfj\" (UniqueName: \"kubernetes.io/projected/843ef1db-219d-4669-811e-8ae5a06568de-kube-api-access-ppgfj\") pod \"limitador-operator-controller-manager-859d7b78bd-4k7jz\" (UID: \"843ef1db-219d-4669-811e-8ae5a06568de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:19.032361 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.032334    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:19.042608 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.042584    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgfj\" (UniqueName: \"kubernetes.io/projected/843ef1db-219d-4669-811e-8ae5a06568de-kube-api-access-ppgfj\") pod \"limitador-operator-controller-manager-859d7b78bd-4k7jz\" (UID: \"843ef1db-219d-4669-811e-8ae5a06568de\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:19.051846 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.051821    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4njt\" (UniqueName: \"kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-69dmp\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:19.256480 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.256453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:19.263619 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:19.263592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:30.323038 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.323011    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:30.325498 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:30.325469    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:30.329766 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.329737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"]
Jul 06 11:37:30.332045 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:30.332021    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843ef1db_219d_4669_811e_8ae5a06568de.slice/crio-720ba95b84afb6dea0425c0fea3ecee54632c688bf2494afd03774f96541a7b6 WatchSource:0}: Error finding container 720ba95b84afb6dea0425c0fea3ecee54632c688bf2494afd03774f96541a7b6: Status 404 returned error can't find the container with id 720ba95b84afb6dea0425c0fea3ecee54632c688bf2494afd03774f96541a7b6
Jul 06 11:37:30.335521 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.335500    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:30.337287 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:30.337263    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:30.338900 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:30.338875    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:30.348787 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.348766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:30.351078 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:30.351049    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3559134b_5b91_40ff_aa82_250cd6a1e974.slice/crio-cecac57f212e0cc42a1271b0a0acec8318faf1eacfe49f58fbb136b9f4dcc8cb WatchSource:0}: Error finding container cecac57f212e0cc42a1271b0a0acec8318faf1eacfe49f58fbb136b9f4dcc8cb: Status 404 returned error can't find the container with id cecac57f212e0cc42a1271b0a0acec8318faf1eacfe49f58fbb136b9f4dcc8cb
Jul 06 11:37:30.435128 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.435045    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftt8x\" (UniqueName: \"kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x\") pod \"247e83ac-2378-4743-8753-c1eb9958a24e\" (UID: \"247e83ac-2378-4743-8753-c1eb9958a24e\") "
Jul 06 11:37:30.435128 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.435095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zstgv\" (UniqueName: \"kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv\") pod \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") "
Jul 06 11:37:30.435128 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.435126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume\") pod \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\" (UID: \"97d0446f-2118-4282-b62f-d7a8ce81ea6c\") "
Jul 06 11:37:30.435731 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.435696    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97d0446f-2118-4282-b62f-d7a8ce81ea6c" (UID: "97d0446f-2118-4282-b62f-d7a8ce81ea6c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 11:37:30.437063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.437027    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x" (OuterVolumeSpecName: "kube-api-access-ftt8x") pod "247e83ac-2378-4743-8753-c1eb9958a24e" (UID: "247e83ac-2378-4743-8753-c1eb9958a24e"). InnerVolumeSpecName "kube-api-access-ftt8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:37:30.437574 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.437556    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv" (OuterVolumeSpecName: "kube-api-access-zstgv") pod "97d0446f-2118-4282-b62f-d7a8ce81ea6c" (UID: "97d0446f-2118-4282-b62f-d7a8ce81ea6c"). InnerVolumeSpecName "kube-api-access-zstgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:37:30.536714 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.536391    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftt8x\" (UniqueName: \"kubernetes.io/projected/247e83ac-2378-4743-8753-c1eb9958a24e-kube-api-access-ftt8x\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:37:30.536714 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.536435    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zstgv\" (UniqueName: \"kubernetes.io/projected/97d0446f-2118-4282-b62f-d7a8ce81ea6c-kube-api-access-zstgv\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:37:30.536714 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.536452    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97d0446f-2118-4282-b62f-d7a8ce81ea6c-extensions-socket-volume\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:37:30.995076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.995043    2581 generic.go:356] "Generic (PLEG): container finished" podID="247e83ac-2378-4743-8753-c1eb9958a24e" containerID="0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d" exitCode=0
Jul 06 11:37:30.995304 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.995098    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:30.995304 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.995173    2581 scope.go:117] "RemoveContainer" containerID="0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d"
Jul 06 11:37:30.996976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.996943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz" event={"ID":"843ef1db-219d-4669-811e-8ae5a06568de","Type":"ContainerStarted","Data":"f4bdb9016ee15c33ed1f5f2259ebaba4974361c427c6eebdb74abb6849d55cd4"}
Jul 06 11:37:30.997100 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.996991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz" event={"ID":"843ef1db-219d-4669-811e-8ae5a06568de","Type":"ContainerStarted","Data":"720ba95b84afb6dea0425c0fea3ecee54632c688bf2494afd03774f96541a7b6"}
Jul 06 11:37:30.997100 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.997059    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:30.997561 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:30.997536    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:30.998735 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.998712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" event={"ID":"3559134b-5b91-40ff-aa82-250cd6a1e974","Type":"ContainerStarted","Data":"3a860eb27b79567fde7cdea64175fc84a92cd48b0a17351d957785bc89ebb5db"}
Jul 06 11:37:30.998840 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.998752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" event={"ID":"3559134b-5b91-40ff-aa82-250cd6a1e974","Type":"ContainerStarted","Data":"cecac57f212e0cc42a1271b0a0acec8318faf1eacfe49f58fbb136b9f4dcc8cb"}
Jul 06 11:37:30.998840 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:30.998799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:30.999073 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:30.999048    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:31.000216 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.000195    2581 generic.go:356] "Generic (PLEG): container finished" podID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" containerID="19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3" exitCode=0
Jul 06 11:37:31.000335 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.000255    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:31.001715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.001697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg" event={"ID":"c28b1ee8-78b4-4667-ae04-151c3b38ee5f","Type":"ContainerStarted","Data":"a1f2e5ae9b2817b812780bad40e2ad8b3802c852bfd945a04c02af9e2d4c1a16"}
Jul 06 11:37:31.005290 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.005275    2581 scope.go:117] "RemoveContainer" containerID="0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d"
Jul 06 11:37:31.005539 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.005522    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d\": container with ID starting with 0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d not found: ID does not exist" containerID="0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d"
Jul 06 11:37:31.005588 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.005546    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d"} err="failed to get container status \"0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d\": rpc error: code = NotFound desc = could not find container \"0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d\": container with ID starting with 0a2afccc91f157a93296b13daa9b39e52bdb8035dd89752da635102fbc2fae4d not found: ID does not exist"
Jul 06 11:37:31.005588 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.005561    2581 scope.go:117] "RemoveContainer" containerID="19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3"
Jul 06 11:37:31.014486 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.014466    2581 scope.go:117] "RemoveContainer" containerID="19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3"
Jul 06 11:37:31.014795 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.014776    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3\": container with ID starting with 19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3 not found: ID does not exist" containerID="19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3"
Jul 06 11:37:31.014862 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.014805    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3"} err="failed to get container status \"19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3\": rpc error: code = NotFound desc = could not find container \"19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3\": container with ID starting with 19bee232529945b7240854d078f4c2d684831eed413c00edfeabe51f37d81db3 not found: ID does not exist"
Jul 06 11:37:31.014983 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.014939    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz" podStartSLOduration=13.014924711 podStartE2EDuration="13.014924711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:31.014416266 +0000 UTC m=+527.725508795" watchObservedRunningTime="2026-07-06 11:37:31.014924711 +0000 UTC m=+527.726017243"
Jul 06 11:37:31.016734 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.016709    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:31.018219 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.018196    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:31.036888 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.036851    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" podStartSLOduration=13.036838852 podStartE2EDuration="13.036838852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:31.03568524 +0000 UTC m=+527.746777770" watchObservedRunningTime="2026-07-06 11:37:31.036838852 +0000 UTC m=+527.747931381"
Jul 06 11:37:31.037456 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.037432    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-z4tl5\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z4tl5"
Jul 06 11:37:31.052949 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.052914    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9krkg" podStartSLOduration=2.592702772 podStartE2EDuration="23.052903512s" totalImagesPullingTime="20.46020074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:31.052504081 +0000 UTC m=+527.763596612" watchObservedRunningTime="2026-07-06 11:37:31.052903512 +0000 UTC m=+527.763996041"
Jul 06 11:37:31.054585 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:37:31.054566    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-pldkr\" is forbidden: User \"system:node:ip-10-0-138-178.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-178.ec2.internal' and this object" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pldkr"
Jul 06 11:37:31.825903 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.825866    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="247e83ac-2378-4743-8753-c1eb9958a24e" path="/var/lib/kubelet/pods/247e83ac-2378-4743-8753-c1eb9958a24e/volumes"
Jul 06 11:37:31.826307 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:31.826233    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d0446f-2118-4282-b62f-d7a8ce81ea6c" path="/var/lib/kubelet/pods/97d0446f-2118-4282-b62f-d7a8ce81ea6c/volumes"
Jul 06 11:37:35.408724 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:35.408689    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:35.409273 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:35.408912    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" podUID="3559134b-5b91-40ff-aa82-250cd6a1e974" containerName="manager" containerID="cri-o://3a860eb27b79567fde7cdea64175fc84a92cd48b0a17351d957785bc89ebb5db" gracePeriod=10
Jul 06 11:37:35.410688 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:35.410663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:36.025586 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.025553    2581 generic.go:356] "Generic (PLEG): container finished" podID="3559134b-5b91-40ff-aa82-250cd6a1e974" containerID="3a860eb27b79567fde7cdea64175fc84a92cd48b0a17351d957785bc89ebb5db" exitCode=0
Jul 06 11:37:36.025731 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.025622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" event={"ID":"3559134b-5b91-40ff-aa82-250cd6a1e974","Type":"ContainerDied","Data":"3a860eb27b79567fde7cdea64175fc84a92cd48b0a17351d957785bc89ebb5db"}
Jul 06 11:37:36.198277 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.198251    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:36.286730 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.286658    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4njt\" (UniqueName: \"kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt\") pod \"3559134b-5b91-40ff-aa82-250cd6a1e974\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") "
Jul 06 11:37:36.286864 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.286735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume\") pod \"3559134b-5b91-40ff-aa82-250cd6a1e974\" (UID: \"3559134b-5b91-40ff-aa82-250cd6a1e974\") "
Jul 06 11:37:36.287185 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.287157    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3559134b-5b91-40ff-aa82-250cd6a1e974" (UID: "3559134b-5b91-40ff-aa82-250cd6a1e974"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 11:37:36.288797 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.288771    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt" (OuterVolumeSpecName: "kube-api-access-s4njt") pod "3559134b-5b91-40ff-aa82-250cd6a1e974" (UID: "3559134b-5b91-40ff-aa82-250cd6a1e974"). InnerVolumeSpecName "kube-api-access-s4njt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:37:36.387942 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.387916    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3559134b-5b91-40ff-aa82-250cd6a1e974-extensions-socket-volume\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:37:36.387942 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:36.387939    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4njt\" (UniqueName: \"kubernetes.io/projected/3559134b-5b91-40ff-aa82-250cd6a1e974-kube-api-access-s4njt\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:37:37.031184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.031155    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"
Jul 06 11:37:37.031184 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.031174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp" event={"ID":"3559134b-5b91-40ff-aa82-250cd6a1e974","Type":"ContainerDied","Data":"cecac57f212e0cc42a1271b0a0acec8318faf1eacfe49f58fbb136b9f4dcc8cb"}
Jul 06 11:37:37.031617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.031237    2581 scope.go:117] "RemoveContainer" containerID="3a860eb27b79567fde7cdea64175fc84a92cd48b0a17351d957785bc89ebb5db"
Jul 06 11:37:37.060260 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.060237    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:37.068495 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.068462    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-69dmp"]
Jul 06 11:37:37.826125 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:37.826092    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3559134b-5b91-40ff-aa82-250cd6a1e974" path="/var/lib/kubelet/pods/3559134b-5b91-40ff-aa82-250cd6a1e974/volumes"
Jul 06 11:37:42.009675 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:42.009647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4k7jz"
Jul 06 11:37:52.112622 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.112589    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"]
Jul 06 11:37:52.113053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.112889    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3559134b-5b91-40ff-aa82-250cd6a1e974" containerName="manager"
Jul 06 11:37:52.113053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.112900    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3559134b-5b91-40ff-aa82-250cd6a1e974" containerName="manager"
Jul 06 11:37:52.113053 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.112952    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3559134b-5b91-40ff-aa82-250cd6a1e974" containerName="manager"
Jul 06 11:37:52.143394 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.143364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"]
Jul 06 11:37:52.143564 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.143479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.146898 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.146873    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h6zh8\""
Jul 06 11:37:52.147012 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.146918    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 11:37:52.219719 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219845 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b1951ae-1b6a-425a-98c5-d83539d526b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219845 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219845 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219954 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8q6c\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-kube-api-access-p8q6c\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219954 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219954 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.219954 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.220084 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.219968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321234 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b1951ae-1b6a-425a-98c5-d83539d526b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8q6c\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-kube-api-access-p8q6c\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321458 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321817 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321660    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321817 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321921 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321840    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.321970 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.321927    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.322020 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.322005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b1951ae-1b6a-425a-98c5-d83539d526b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.323725 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.323695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.323846 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.323796    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.331755 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.331735    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.332617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.332601    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8q6c\" (UniqueName: \"kubernetes.io/projected/4b1951ae-1b6a-425a-98c5-d83539d526b1-kube-api-access-p8q6c\") pod \"maas-default-gateway-openshift-default-5896d4dd49-xk8vw\" (UID: \"4b1951ae-1b6a-425a-98c5-d83539d526b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.454385 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.454312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:52.606800 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:52.606771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"]
Jul 06 11:37:52.609856 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:52.609828    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1951ae_1b6a_425a_98c5_d83539d526b1.slice/crio-3d2fcee50136ddbf13bd81b495ddd9cc5de76630a4e988fd35f3abd8a164d672 WatchSource:0}: Error finding container 3d2fcee50136ddbf13bd81b495ddd9cc5de76630a4e988fd35f3abd8a164d672: Status 404 returned error can't find the container with id 3d2fcee50136ddbf13bd81b495ddd9cc5de76630a4e988fd35f3abd8a164d672
Jul 06 11:37:53.099112 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:53.099078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" event={"ID":"4b1951ae-1b6a-425a-98c5-d83539d526b1","Type":"ContainerStarted","Data":"3d2fcee50136ddbf13bd81b495ddd9cc5de76630a4e988fd35f3abd8a164d672"}
Jul 06 11:37:54.809241 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:54.809205    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:37:54.809499 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:54.809284    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:37:54.809499 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:54.809314    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:37:55.110261 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:55.110177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" event={"ID":"4b1951ae-1b6a-425a-98c5-d83539d526b1","Type":"ContainerStarted","Data":"fa9cc8f46a692d6bc13b4a7dee20b2fa215ea17524be7ece56ff86a729d6d90d"}
Jul 06 11:37:55.132112 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:55.132066    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" podStartSLOduration=0.934863416 podStartE2EDuration="3.132050716s" totalImagesPullingTime="2.1971873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:37:55.131214469 +0000 UTC m=+551.842306997" watchObservedRunningTime="2026-07-06 11:37:55.132050716 +0000 UTC m=+551.843143246"
Jul 06 11:37:55.455297 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:55.455213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:55.459976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:55.459951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:56.114564 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.114528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:56.115453 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.115431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:37:56.307700 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.307666    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:37:56.309975 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.309960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.312217 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.312194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 11:37:56.322950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.322926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:37:56.357728 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.357694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzct\" (UniqueName: \"kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.357901 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.357786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.390748 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.390672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:37:56.458838 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.458807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.458995 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.458902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzct\" (UniqueName: \"kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.459485 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.459463    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.467617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.467596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzct\" (UniqueName: \"kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct\") pod \"limitador-limitador-64c94fd64f-sfpk4\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.619497 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.619466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:37:56.773561 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.773531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:37:56.777002 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:56.776974    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode336ece9_cb00_4ee3_a63f_a9ddbf9c81f2.slice/crio-1e0ddda92161327be5e88094ef93e14de4a386e26e5b6e548e65ea30d8af8174 WatchSource:0}: Error finding container 1e0ddda92161327be5e88094ef93e14de4a386e26e5b6e548e65ea30d8af8174: Status 404 returned error can't find the container with id 1e0ddda92161327be5e88094ef93e14de4a386e26e5b6e548e65ea30d8af8174
Jul 06 11:37:56.846360 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.846336    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:37:56.849076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.849060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.861293 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.861272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:37:56.862877 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.862852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkhhm\" (UniqueName: \"kubernetes.io/projected/2b6d525c-e8b0-4946-9879-9a939ae52165-kube-api-access-kkhhm\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.863009 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.862988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b6d525c-e8b0-4946-9879-9a939ae52165-config-file\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.907932 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.907906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:37:56.964076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.964020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b6d525c-e8b0-4946-9879-9a939ae52165-config-file\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.964076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.964065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkhhm\" (UniqueName: \"kubernetes.io/projected/2b6d525c-e8b0-4946-9879-9a939ae52165-kube-api-access-kkhhm\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.964607 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.964589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b6d525c-e8b0-4946-9879-9a939ae52165-config-file\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:56.972910 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:56.972886    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkhhm\" (UniqueName: \"kubernetes.io/projected/2b6d525c-e8b0-4946-9879-9a939ae52165-kube-api-access-kkhhm\") pod \"limitador-limitador-54d6d988d5-6shsn\" (UID: \"2b6d525c-e8b0-4946-9879-9a939ae52165\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:57.119797 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:57.119771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" event={"ID":"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2","Type":"ContainerStarted","Data":"1e0ddda92161327be5e88094ef93e14de4a386e26e5b6e548e65ea30d8af8174"}
Jul 06 11:37:57.158462 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:57.158437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:37:57.296537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:57.296492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:37:57.298736 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:37:57.298708    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6d525c_e8b0_4946_9879_9a939ae52165.slice/crio-1f46ee50e09199ffdd2974ed7ac01dbceded45af7960a99ad937799d216d94c8 WatchSource:0}: Error finding container 1f46ee50e09199ffdd2974ed7ac01dbceded45af7960a99ad937799d216d94c8: Status 404 returned error can't find the container with id 1f46ee50e09199ffdd2974ed7ac01dbceded45af7960a99ad937799d216d94c8
Jul 06 11:37:58.126330 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:37:58.126257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn" event={"ID":"2b6d525c-e8b0-4946-9879-9a939ae52165","Type":"ContainerStarted","Data":"1f46ee50e09199ffdd2974ed7ac01dbceded45af7960a99ad937799d216d94c8"}
Jul 06 11:38:00.138260 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.138224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" event={"ID":"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2","Type":"ContainerStarted","Data":"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"}
Jul 06 11:38:00.138665 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.138388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:38:00.139813 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.139785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn" event={"ID":"2b6d525c-e8b0-4946-9879-9a939ae52165","Type":"ContainerStarted","Data":"80a7fcf6e2a25caf637baad8eb3dd5d550e323377232f28d0a8dcb86b069ff3b"}
Jul 06 11:38:00.139950 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.139838    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:38:00.157924 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.157883    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" podStartSLOduration=1.188512971 podStartE2EDuration="4.157871793s" totalImagesPullingTime="2.969358822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:38:00.155733547 +0000 UTC m=+556.866826076" watchObservedRunningTime="2026-07-06 11:38:00.157871793 +0000 UTC m=+556.868964323"
Jul 06 11:38:00.190306 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:00.190269    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn" podStartSLOduration=1.735376969 podStartE2EDuration="4.190256298s" totalImagesPullingTime="2.454879329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:38:00.189452771 +0000 UTC m=+556.900545303" watchObservedRunningTime="2026-07-06 11:38:00.190256298 +0000 UTC m=+556.901348886"
Jul 06 11:38:11.145481 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.145449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6shsn"
Jul 06 11:38:11.145947 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.145513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:38:11.270568 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.270539    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:38:11.270762 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.270725    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" podUID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" containerName="limitador" containerID="cri-o://310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3" gracePeriod=30
Jul 06 11:38:11.815955 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.815931    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:38:11.896299 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.896233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file\") pod \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") "
Jul 06 11:38:11.896299 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.896281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqzct\" (UniqueName: \"kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct\") pod \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\" (UID: \"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2\") "
Jul 06 11:38:11.896672 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.896635    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file" (OuterVolumeSpecName: "config-file") pod "e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" (UID: "e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 11:38:11.898375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.898352    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct" (OuterVolumeSpecName: "kube-api-access-gqzct") pod "e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" (UID: "e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2"). InnerVolumeSpecName "kube-api-access-gqzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 11:38:11.997697 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.997670    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-config-file\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:38:11.997697 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:11.997698    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzct\" (UniqueName: \"kubernetes.io/projected/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2-kube-api-access-gqzct\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 11:38:12.190631 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.190548    2581 generic.go:356] "Generic (PLEG): container finished" podID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" containerID="310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3" exitCode=0
Jul 06 11:38:12.190631 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.190594    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"
Jul 06 11:38:12.191063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.190632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" event={"ID":"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2","Type":"ContainerDied","Data":"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"}
Jul 06 11:38:12.191063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.190687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sfpk4" event={"ID":"e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2","Type":"ContainerDied","Data":"1e0ddda92161327be5e88094ef93e14de4a386e26e5b6e548e65ea30d8af8174"}
Jul 06 11:38:12.191063 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.190716    2581 scope.go:117] "RemoveContainer" containerID="310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"
Jul 06 11:38:12.198887 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.198871    2581 scope.go:117] "RemoveContainer" containerID="310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"
Jul 06 11:38:12.199124 ip-10-0-138-178 kubenswrapper[2581]: E0706 11:38:12.199097    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3\": container with ID starting with 310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3 not found: ID does not exist" containerID="310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"
Jul 06 11:38:12.199209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.199124    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3"} err="failed to get container status \"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3\": rpc error: code = NotFound desc = could not find container \"310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3\": container with ID starting with 310eb0c95f64b3e1fe0f025f89ef2609f0aed74e90239a50c2380cc3098adac3 not found: ID does not exist"
Jul 06 11:38:12.214503 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.214475    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:38:12.220006 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:12.219984    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sfpk4"]
Jul 06 11:38:13.827435 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:13.827406    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" path="/var/lib/kubelet/pods/e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2/volumes"
Jul 06 11:38:17.795997 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.795968    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-6hvkc"]
Jul 06 11:38:17.796364 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.796339    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" containerName="limitador"
Jul 06 11:38:17.796364 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.796353    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" containerName="limitador"
Jul 06 11:38:17.796447 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.796436    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e336ece9-cb00-4ee3-a63f-a9ddbf9c81f2" containerName="limitador"
Jul 06 11:38:17.800795 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.800775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:17.803275 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.803254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 11:38:17.803929 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.803915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z2btv\""
Jul 06 11:38:17.811021 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.811001    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6hvkc"]
Jul 06 11:38:17.943943 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.943909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslb5\" (UniqueName: \"kubernetes.io/projected/ec13e12e-701c-492b-8437-632931af964b-kube-api-access-cslb5\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:17.944120 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:17.944011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ec13e12e-701c-492b-8437-632931af964b-data\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.045407 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.045375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslb5\" (UniqueName: \"kubernetes.io/projected/ec13e12e-701c-492b-8437-632931af964b-kube-api-access-cslb5\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.045550 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.045432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ec13e12e-701c-492b-8437-632931af964b-data\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.045739 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.045722    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ec13e12e-701c-492b-8437-632931af964b-data\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.054595 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.054538    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslb5\" (UniqueName: \"kubernetes.io/projected/ec13e12e-701c-492b-8437-632931af964b-kube-api-access-cslb5\") pod \"postgres-69fb4594cf-6hvkc\" (UID: \"ec13e12e-701c-492b-8437-632931af964b\") " pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.111787 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.111761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:18.238295 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:18.238268    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-6hvkc"]
Jul 06 11:38:18.241393 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:38:18.241368    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec13e12e_701c_492b_8437_632931af964b.slice/crio-eff2cc71c1db0c3a5e9bc5c0cfbda7c1b6d93a04e5f3a3d2581c89ca26ec8fde WatchSource:0}: Error finding container eff2cc71c1db0c3a5e9bc5c0cfbda7c1b6d93a04e5f3a3d2581c89ca26ec8fde: Status 404 returned error can't find the container with id eff2cc71c1db0c3a5e9bc5c0cfbda7c1b6d93a04e5f3a3d2581c89ca26ec8fde
Jul 06 11:38:19.224887 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:19.224801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6hvkc" event={"ID":"ec13e12e-701c-492b-8437-632931af964b","Type":"ContainerStarted","Data":"eff2cc71c1db0c3a5e9bc5c0cfbda7c1b6d93a04e5f3a3d2581c89ca26ec8fde"}
Jul 06 11:38:23.246288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:23.246214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-6hvkc" event={"ID":"ec13e12e-701c-492b-8437-632931af964b","Type":"ContainerStarted","Data":"2dc2f4b586e8394fe56b217e77d519f380fd70124de7db48a93a20dcbb512afc"}
Jul 06 11:38:23.246288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:23.246284    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:23.265396 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:23.265337    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-6hvkc" podStartSLOduration=1.5242630990000001 podStartE2EDuration="6.265315853s" totalImagesPullingTime="4.741052754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:38:23.263362747 +0000 UTC m=+579.974455278" watchObservedRunningTime="2026-07-06 11:38:23.265315853 +0000 UTC m=+579.976408385"
Jul 06 11:38:29.280005 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:29.279972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-6hvkc"
Jul 06 11:38:43.758798 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:43.758766    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:38:43.759356 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:43.759039    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:38:43.762441 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:43.762422    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:38:43.762820 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:38:43.762802    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:39:12.946744 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:12.946668    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbdh8"]
Jul 06 11:39:12.949862 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:12.949846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:12.952248 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:12.952228    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 11:39:12.960291 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:12.960256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbdh8"]
Jul 06 11:39:13.026017 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.025991    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:39:13.109776 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.109742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xphtg\" (UniqueName: \"kubernetes.io/projected/30b092d1-18e2-43c1-965b-68cd18dd00a0-kube-api-access-xphtg\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.109937 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.109803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b092d1-18e2-43c1-965b-68cd18dd00a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.211255 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.211169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xphtg\" (UniqueName: \"kubernetes.io/projected/30b092d1-18e2-43c1-965b-68cd18dd00a0-kube-api-access-xphtg\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.211255 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.211248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b092d1-18e2-43c1-965b-68cd18dd00a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.211890 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.211872    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b092d1-18e2-43c1-965b-68cd18dd00a0-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.219670 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.219639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xphtg\" (UniqueName: \"kubernetes.io/projected/30b092d1-18e2-43c1-965b-68cd18dd00a0-kube-api-access-xphtg\") pod \"payload-processing-58f86c7798-xbdh8\" (UID: \"30b092d1-18e2-43c1-965b-68cd18dd00a0\") " pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.259685 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.259649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:13.386339 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.386316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbdh8"]
Jul 06 11:39:13.388654 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:39:13.388624    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b092d1_18e2_43c1_965b_68cd18dd00a0.slice/crio-70f59a489e080e0d7d672ba47f7938245fd69009a4c4391b6b31497b90dbb433 WatchSource:0}: Error finding container 70f59a489e080e0d7d672ba47f7938245fd69009a4c4391b6b31497b90dbb433: Status 404 returned error can't find the container with id 70f59a489e080e0d7d672ba47f7938245fd69009a4c4391b6b31497b90dbb433
Jul 06 11:39:13.458978 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:13.458950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8" event={"ID":"30b092d1-18e2-43c1-965b-68cd18dd00a0","Type":"ContainerStarted","Data":"70f59a489e080e0d7d672ba47f7938245fd69009a4c4391b6b31497b90dbb433"}
Jul 06 11:39:15.470575 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:15.470535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8" event={"ID":"30b092d1-18e2-43c1-965b-68cd18dd00a0","Type":"ContainerStarted","Data":"faa416dae00d018a833028e0b8e860f107dd9e863734d8c03b7c7693d3b193f6"}
Jul 06 11:39:15.471076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:15.470666    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:15.487724 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:15.487664    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8" podStartSLOduration=1.952435194 podStartE2EDuration="3.48765078s" totalImagesPullingTime="1.535215586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:39:15.486004189 +0000 UTC m=+632.197096721" watchObservedRunningTime="2026-07-06 11:39:15.48765078 +0000 UTC m=+632.198743310"
Jul 06 11:39:20.494292 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.494264    2581 generic.go:356] "Generic (PLEG): container finished" podID="4b1951ae-1b6a-425a-98c5-d83539d526b1" containerID="fa9cc8f46a692d6bc13b4a7dee20b2fa215ea17524be7ece56ff86a729d6d90d" exitCode=0
Jul 06 11:39:20.494640 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.494332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" event={"ID":"4b1951ae-1b6a-425a-98c5-d83539d526b1","Type":"ContainerDied","Data":"fa9cc8f46a692d6bc13b4a7dee20b2fa215ea17524be7ece56ff86a729d6d90d"}
Jul 06 11:39:20.494696 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.494682    2581 scope.go:117] "RemoveContainer" containerID="fa9cc8f46a692d6bc13b4a7dee20b2fa215ea17524be7ece56ff86a729d6d90d"
Jul 06 11:39:20.495662 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.495633    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:39:20.495721 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.495709    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:39:20.495761 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:20.495741    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 11:39:21.501265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:21.501233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" event={"ID":"4b1951ae-1b6a-425a-98c5-d83539d526b1","Type":"ContainerStarted","Data":"dbeb0422e03278073d2437c6ab521d4abcd7b42b8fca14ecb723daaa344bd633"}
Jul 06 11:39:22.455281 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:22.455217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:39:22.456434 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:22.456409    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xk8vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 06 11:39:22.456521 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:22.456465    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" podUID="4b1951ae-1b6a-425a-98c5-d83539d526b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 06 11:39:23.455612 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:23.455576    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xk8vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 06 11:39:23.455988 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:23.455646    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" podUID="4b1951ae-1b6a-425a-98c5-d83539d526b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 06 11:39:24.455433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:24.455398    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xk8vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 06 11:39:24.455633 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:24.455456    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" podUID="4b1951ae-1b6a-425a-98c5-d83539d526b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 06 11:39:25.455715 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:25.455670    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-xk8vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 06 11:39:25.456112 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:25.455736    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw" podUID="4b1951ae-1b6a-425a-98c5-d83539d526b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 06 11:39:26.114754 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:26.114719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:39:26.459576 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:26.459502    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:39:26.477107 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:26.477081    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-xbdh8"
Jul 06 11:39:26.524764 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:26.524732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-xk8vw"
Jul 06 11:39:30.019921 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:30.019885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:39:43.789941 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.789912    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"]
Jul 06 11:39:43.793227 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.793210    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.796061 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.796037    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 11:39:43.796237 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.796037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lkq6q\""
Jul 06 11:39:43.796237 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.796109    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 11:39:43.796237 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.796119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 11:39:43.804436 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.804416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"]
Jul 06 11:39:43.877878 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.877844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4nqr\" (UniqueName: \"kubernetes.io/projected/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-kube-api-access-n4nqr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.878052 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.877899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.878052 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.877980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.878173 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.878065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.878173 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.878129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.878290 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.878268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979375 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4nqr\" (UniqueName: \"kubernetes.io/projected/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-kube-api-access-n4nqr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979731 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979705    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979879 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979850    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.979996 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.979890    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.981723 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.981705    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.981854 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.981834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:43.988074 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:43.988052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4nqr\" (UniqueName: \"kubernetes.io/projected/cc854a3c-0307-44d0-8ec3-d7c8c535b80b-kube-api-access-n4nqr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-clxv7\" (UID: \"cc854a3c-0307-44d0-8ec3-d7c8c535b80b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:44.103376 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:44.103311    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:44.237208 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:44.237178    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"]
Jul 06 11:39:44.240732 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:39:44.240700    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc854a3c_0307_44d0_8ec3_d7c8c535b80b.slice/crio-2326e89da9a7bd20ab5f2e0fb71ad1febb658d8377e380a46f667f99aa208b98 WatchSource:0}: Error finding container 2326e89da9a7bd20ab5f2e0fb71ad1febb658d8377e380a46f667f99aa208b98: Status 404 returned error can't find the container with id 2326e89da9a7bd20ab5f2e0fb71ad1febb658d8377e380a46f667f99aa208b98
Jul 06 11:39:44.404926 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:44.404845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:39:44.604209 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:44.604164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7" event={"ID":"cc854a3c-0307-44d0-8ec3-d7c8c535b80b","Type":"ContainerStarted","Data":"2326e89da9a7bd20ab5f2e0fb71ad1febb658d8377e380a46f667f99aa208b98"}
Jul 06 11:39:45.609838 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:45.609803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7" event={"ID":"cc854a3c-0307-44d0-8ec3-d7c8c535b80b","Type":"ContainerStarted","Data":"28294cfe2afd7e8a24f3b3249e181067500e49695f0e7476df4628cd21b4ebc3"}
Jul 06 11:39:45.628893 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:45.628796    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7" podStartSLOduration=1.494495009 podStartE2EDuration="2.62877887s" totalImagesPullingTime="1.134283861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:39:45.628457564 +0000 UTC m=+662.339550107" watchObservedRunningTime="2026-07-06 11:39:45.62877887 +0000 UTC m=+662.339871402"
Jul 06 11:39:51.802321 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:51.802286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:39:54.104038 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:54.104004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:54.104532 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:54.104074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:54.116619 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:54.116594    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:54.659717 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:54.659680    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-clxv7"
Jul 06 11:39:57.892613 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:39:57.892579    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:40:36.805759 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.805680    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"]
Jul 06 11:40:36.810765 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.810742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.812735 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.812716    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 11:40:36.818818 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.818793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"]
Jul 06 11:40:36.911537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.911537 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.911743 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.911743 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wnh\" (UniqueName: \"kubernetes.io/projected/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-kube-api-access-55wnh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.911743 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:36.911743 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:36.911664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013065 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013065 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013276 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013276 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wnh\" (UniqueName: \"kubernetes.io/projected/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-kube-api-access-55wnh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013276 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013276 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013519 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013495    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013622 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013555    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.013622 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.013593    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.015505 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.015484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.015594 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.015544    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.022655 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.022626    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wnh\" (UniqueName: \"kubernetes.io/projected/f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3-kube-api-access-55wnh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mcbvc\" (UID: \"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.121861 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.121797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:37.252191 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.252160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"]
Jul 06 11:40:37.255012 ip-10-0-138-178 kubenswrapper[2581]: W0706 11:40:37.254971    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e4dfd6_77b2_4b43_bea4_9b7c567f17d3.slice/crio-f13b43518163944b9f3d56ba245fc35dc0e8788c64419198b0a37b52a2fd8e3f WatchSource:0}: Error finding container f13b43518163944b9f3d56ba245fc35dc0e8788c64419198b0a37b52a2fd8e3f: Status 404 returned error can't find the container with id f13b43518163944b9f3d56ba245fc35dc0e8788c64419198b0a37b52a2fd8e3f
Jul 06 11:40:37.256455 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.256436    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 11:40:37.852598 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.852563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc" event={"ID":"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3","Type":"ContainerStarted","Data":"e99b931b712cd9cd6718310369bf8856e94ac7af2f1abdbec6cc2c6c9ed4debc"}
Jul 06 11:40:37.853006 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.852619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc" event={"ID":"f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3","Type":"ContainerStarted","Data":"f13b43518163944b9f3d56ba245fc35dc0e8788c64419198b0a37b52a2fd8e3f"}
Jul 06 11:40:37.869633 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:37.869585    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc" podStartSLOduration=1.661971624 podStartE2EDuration="1.869570464s" totalImagesPullingTime="207.59884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 11:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 11:40:37.869376368 +0000 UTC m=+714.580468899" watchObservedRunningTime="2026-07-06 11:40:37.869570464 +0000 UTC m=+714.580662994"
Jul 06 11:40:39.301433 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:39.301406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:40:47.122256 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:47.122209    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:47.122763 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:47.122327    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:47.134937 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:47.134916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:47.912076 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:47.912050    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mcbvc"
Jul 06 11:40:56.639790 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:40:56.639759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:42:30.203080 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:42:30.203043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:42:40.493731 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:42:40.493698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:42:50.889280 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:42:50.889247    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:43:00.906910 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:00.906870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:43:10.601509 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:10.601465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:43:38.454230 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:38.454127    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:43:43.785906 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:43.785869    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:43:43.787262 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:43.787231    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:43:43.789377 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:43.789362    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:43:43.790617 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:43.790599    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:43:49.745567 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:43:49.745538    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:44:35.298980 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:44:35.298941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:44:44.717907 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:44:44.717875    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:44:55.309557 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:44:55.309517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:45:03.604980 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:45:03.604939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:45:14.116572 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:45:14.116499    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:45:23.972043 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:45:23.972013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:45:35.244170 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:45:35.244123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:45:44.909796 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:45:44.909760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:46:07.251800 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:46:07.251763    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:46:19.542088 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:46:19.542046    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:46:45.207230 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:46:45.207153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:46:56.374880 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:46:56.374848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:47:11.971228 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:47:11.971195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:47:21.128106 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:47:21.128071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:47:31.323811 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:47:31.323776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:47:40.848679 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:47:40.848646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:47:50.031368 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:47:50.031337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:48:43.811531 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:48:43.811501    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:48:43.815381 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:48:43.815361    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:48:43.815381 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:48:43.815377    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:48:43.819115 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:48:43.819099    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:49:38.544608 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:49:38.544518    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:49:50.228710 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:49:50.228674    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:03.027823 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:03.027792    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:12.205668 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:12.205632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:29.742071 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:29.742038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:39.307273 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:39.307241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:51.099206 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:51.099169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:50:59.636167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:50:59.635208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:51:11.104704 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:51:11.104621    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:51:22.809786 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:51:22.809753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:51:29.917690 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:51:29.917655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:51:48.125854 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:51:48.125811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:51:57.671961 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:51:57.671931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:52:08.308166 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:52:08.308111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:52:20.120037 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:52:20.120004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:52:36.961288 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:52:36.961210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:52:46.119780 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:52:46.119747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:52:55.011849 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:52:55.011813    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:02.565630 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:02.565589    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:12.954418 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:12.954384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:22.253829 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:22.253796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:35.942442 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:35.942410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:43.841486 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:43.841454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:53:43.844818 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:43.844794    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:53:43.845956 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:43.845936    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:53:43.849472 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:43.849454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:53:45.204944 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:45.204902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:53:54.169590 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:53:54.169541    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:54:05.369032 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:54:05.368998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:54:19.235976 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:54:19.235943    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:54:27.658151 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:54:27.658100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:54:39.613777 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:54:39.613743    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:54:51.615265 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:54:51.615228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:55:00.702810 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:55:00.702780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:55:16.796990 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:55:16.796955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:55:29.494167 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:55:29.494064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:55:48.795621 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:55:48.795584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:56:00.996374 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:56:00.996336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:57:20.093519 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:57:20.093442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:57:28.494586 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:57:28.494550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:57:40.592268 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:57:40.592233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:57:54.301682 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:57:54.301651    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:58:23.304877 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:23.304835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:58:37.996391 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:37.996318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:58:43.867694 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:43.867649    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:58:43.871329 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:43.871309    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:58:43.873883 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:43.873861    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 11:58:43.878322 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:43.878304    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 11:58:52.193720 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:58:52.193670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:59:06.392108 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:59:06.392067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:59:45.094756 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:59:45.094718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 11:59:59.397310 ip-10-0-138-178 kubenswrapper[2581]: I0706 11:59:59.397270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:00:09.092407 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:09.092319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:00:51.975446 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:51.975406    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:00:51.979002 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:51.978983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:51.980989 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:51.980966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f369e4-openshift-default-dockercfg-m4clj\""
Jul 06 12:00:51.988344 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:51.988321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:00:52.087320 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087519 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smm9\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.087785 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.087582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188036 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.187997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188242 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188242 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188242 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188396 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188396 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smm9\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188396 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188495    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188514    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188820 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188744    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188820 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188768    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.188936 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.188893    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.190596 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.190575    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.190752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.190733    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.195356 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.195330    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.195507 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.195492    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smm9\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9\") pod \"e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") " pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.289938 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.289918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:52.423807 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.423780    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:00:52.426229 ip-10-0-138-178 kubenswrapper[2581]: W0706 12:00:52.426198    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dab6ea6_0730_41de_aa0c_69f60b794e4c.slice/crio-ca54abcb0dfe34ccf7c2c96a0770ad2538362a7064eae99cd3f0fb68bb5a43b0 WatchSource:0}: Error finding container ca54abcb0dfe34ccf7c2c96a0770ad2538362a7064eae99cd3f0fb68bb5a43b0: Status 404 returned error can't find the container with id ca54abcb0dfe34ccf7c2c96a0770ad2538362a7064eae99cd3f0fb68bb5a43b0
Jul 06 12:00:52.428946 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.428911    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:00:52.429023 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.428992    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:00:52.429061 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:52.429035    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:00:53.094146 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:53.094095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:00:53.295808 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:53.295769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerStarted","Data":"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"}
Jul 06 12:00:53.295961 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:53.295816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerStarted","Data":"ca54abcb0dfe34ccf7c2c96a0770ad2538362a7064eae99cd3f0fb68bb5a43b0"}
Jul 06 12:00:53.312722 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:53.312673    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podStartSLOduration=2.312652139 podStartE2EDuration="2.312652139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:00:53.312306233 +0000 UTC m=+1930.023398766" watchObservedRunningTime="2026-07-06 12:00:53.312652139 +0000 UTC m=+1930.023744680"
Jul 06 12:00:54.290287 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:54.290260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:54.296156 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:54.296116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:54.299730 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:54.299706    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:00:54.300411 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:00:54.300393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:07.888866 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:07.888835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:01:08.372444 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.372413    2581 generic.go:356] "Generic (PLEG): container finished" podID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerID="3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0" exitCode=0
Jul 06 12:01:08.372620 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.372457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerDied","Data":"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"}
Jul 06 12:01:08.372822 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.372808    2581 scope.go:117] "RemoveContainer" containerID="3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"
Jul 06 12:01:08.373803 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.373774    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:01:08.373882 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.373842    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:01:08.373882 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:08.373877    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:01:09.300207 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:09.300178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:09.383627 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:09.379639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerStarted","Data":"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"}
Jul 06 12:01:10.290435 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:10.290401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:10.291609 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:10.291581    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 06 12:01:10.291760 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:10.291633    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 06 12:01:11.290884 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:11.290848    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 06 12:01:11.291291 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:11.290909    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 06 12:01:12.290385 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:12.290349    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 06 12:01:12.290565 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:12.290412    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 06 12:01:13.293884 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:13.293855    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:13.294337 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:13.294241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:13.294830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:13.294808    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:01:15.989513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:15.989482    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:01:26.988065 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:26.988031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:01:48.186329 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:01:48.186287    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:02:04.685809 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:02:04.685775    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:02:23.303568 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:02:23.303536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:03:09.799708 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:09.799624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:03:10.307198 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:10.307167    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:03:10.307391 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:10.307365    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy" containerID="cri-o://cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3" gracePeriod=30
Jul 06 12:03:13.296899 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:13.296861    2581 patch_prober.go:28] interesting pod/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:03:13.297291 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:13.296927    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:03:15.556489 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.556463    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:03:15.708269 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708269 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708269 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708514 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708277    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smm9\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708514 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708514 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708667 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708667 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708572    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708667 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708639    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs\") pod \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\" (UID: \"6dab6ea6-0730-41de-aa0c-69f60b794e4c\") "
Jul 06 12:03:15.708827 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708525    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:15.708827 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708763    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:15.708827 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708799    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:03:15.708992 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708949    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-credential-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.708992 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708966    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.708992 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.708981    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istiod-ca-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.709174 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.709065    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:15.709241 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.709209    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:15.710741 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.710710    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:03:15.710854 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.710721    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:15.710959 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.710941    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:03:15.710999 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.710952    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9" (OuterVolumeSpecName: "kube-api-access-7smm9") pod "6dab6ea6-0730-41de-aa0c-69f60b794e4c" (UID: "6dab6ea6-0730-41de-aa0c-69f60b794e4c"). InnerVolumeSpecName "kube-api-access-7smm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:03:15.809938 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809907    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-workload-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.809938 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809932    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-token\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.809938 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809942    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-data\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.810177 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809950    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smm9\" (UniqueName: \"kubernetes.io/projected/6dab6ea6-0730-41de-aa0c-69f60b794e4c-kube-api-access-7smm9\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.810177 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809958    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-podinfo\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.810177 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.809965    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dab6ea6-0730-41de-aa0c-69f60b794e4c-istio-envoy\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:15.955616 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.955586    2581 generic.go:356] "Generic (PLEG): container finished" podID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerID="cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3" exitCode=0
Jul 06 12:03:15.955781 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.955637    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"
Jul 06 12:03:15.955781 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.955682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerDied","Data":"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"}
Jul 06 12:03:15.955781 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.955733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7" event={"ID":"6dab6ea6-0730-41de-aa0c-69f60b794e4c","Type":"ContainerDied","Data":"ca54abcb0dfe34ccf7c2c96a0770ad2538362a7064eae99cd3f0fb68bb5a43b0"}
Jul 06 12:03:15.955781 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.955754    2581 scope.go:117] "RemoveContainer" containerID="cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"
Jul 06 12:03:15.964336 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.964319    2581 scope.go:117] "RemoveContainer" containerID="3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"
Jul 06 12:03:15.971267 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.971247    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:03:15.972000 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.971987    2581 scope.go:117] "RemoveContainer" containerID="cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"
Jul 06 12:03:15.972308 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:03:15.972288    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3\": container with ID starting with cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3 not found: ID does not exist" containerID="cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"
Jul 06 12:03:15.972389 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.972316    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3"} err="failed to get container status \"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3\": rpc error: code = NotFound desc = could not find container \"cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3\": container with ID starting with cc295d4104f4ddd81bfe43fe2adff63805bc2d3bebca560f98bfaa1b56f429d3 not found: ID does not exist"
Jul 06 12:03:15.972389 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.972332    2581 scope.go:117] "RemoveContainer" containerID="3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"
Jul 06 12:03:15.972576 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:03:15.972554    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0\": container with ID starting with 3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0 not found: ID does not exist" containerID="3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"
Jul 06 12:03:15.972616 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.972586    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0"} err="failed to get container status \"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0\": rpc error: code = NotFound desc = could not find container \"3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0\": container with ID starting with 3189b65f8b5ade849290ecb37d2069b3b851b4592f4b8fdf4481591be6bd93a0 not found: ID does not exist"
Jul 06 12:03:15.974651 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:15.974632    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f369e4-openshift-default-86cdfd96bf-nkjf7"]
Jul 06 12:03:17.826428 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:17.826400    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" path="/var/lib/kubelet/pods/6dab6ea6-0730-41de-aa0c-69f60b794e4c/volumes"
Jul 06 12:03:19.962978 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.962948    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:19.963357 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963293    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.963357 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963305    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.963357 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963321    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.963357 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963327    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.963483 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963389    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.963483 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.963395    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dab6ea6-0730-41de-aa0c-69f60b794e4c" containerName="istio-proxy"
Jul 06 12:03:19.966341 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.966326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:19.968613 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.968591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f43438-openshift-default-dockercfg-295pr\""
Jul 06 12:03:19.981222 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:19.981199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:20.147221 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147221 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147433 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147433 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9fjh\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147433 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147433 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147433 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147591 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.147591 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.147471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.248770 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.248770 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.248770 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.248770 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9fjh\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249093 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249093 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249093 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249093 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249093 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.248947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.249158    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.249336    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249535 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.249435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249535 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.249468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.249603 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.249560    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.251099 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.251079    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.251244 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.251226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.257080 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.257060    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.257209 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.257123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9fjh\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh\") pod \"e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") " pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.276191 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.276169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:20.407542 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.407455    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:20.410160 ip-10-0-138-178 kubenswrapper[2581]: W0706 12:03:20.410117    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd426da4_2805_4003_8920_b6c2b37e0871.slice/crio-028ee5ab7ef6121144c8e8a9aaabf28c8a11433932ecad3916461262ec708f41 WatchSource:0}: Error finding container 028ee5ab7ef6121144c8e8a9aaabf28c8a11433932ecad3916461262ec708f41: Status 404 returned error can't find the container with id 028ee5ab7ef6121144c8e8a9aaabf28c8a11433932ecad3916461262ec708f41
Jul 06 12:03:20.412241 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.412197    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:20.412338 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.412263    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:20.412338 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.412290    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:20.981075 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.981035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerStarted","Data":"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"}
Jul 06 12:03:20.981475 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:20.981091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerStarted","Data":"028ee5ab7ef6121144c8e8a9aaabf28c8a11433932ecad3916461262ec708f41"}
Jul 06 12:03:21.000824 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:21.000777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podStartSLOduration=2.000757065 podStartE2EDuration="2.000757065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:03:20.999447887 +0000 UTC m=+2077.710540416" watchObservedRunningTime="2026-07-06 12:03:21.000757065 +0000 UTC m=+2077.711849594"
Jul 06 12:03:21.276853 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:21.276803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:21.282548 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:21.282525    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:21.986387 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:21.986351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:21.987250 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:21.987230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:22.588336 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:22.588306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:03:37.796776 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:37.796746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:03:38.028329 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:38.028287    2581 patch_prober.go:28] interesting pod/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 12:03:38.028496 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:38.028347    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 12:03:39.074663 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.074627    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd426da4-2805-4003-8920-b6c2b37e0871" containerID="842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7" exitCode=0
Jul 06 12:03:39.075154 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.074701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerDied","Data":"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"}
Jul 06 12:03:39.075154 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.075091    2581 scope.go:117] "RemoveContainer" containerID="842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"
Jul 06 12:03:39.076044 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.076019    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:39.076098 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.076084    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:39.076151 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:39.076124    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:40.081627 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:40.081587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerStarted","Data":"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"}
Jul 06 12:03:40.276603 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:40.276565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:40.276785 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:40.276763    2581 patch_prober.go:28] interesting pod/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 12:03:40.276835 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:40.276810    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 12:03:41.277031 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:41.276995    2581 patch_prober.go:28] interesting pod/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 12:03:41.277526 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:41.277055    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 12:03:42.276768 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:42.276733    2581 patch_prober.go:28] interesting pod/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 12:03:42.276939 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:42.276790    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 12:03:43.276950 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.276918    2581 patch_prober.go:28] interesting pod/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 06 12:03:43.277349 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.276975    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 06 12:03:43.901167 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.901125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 12:03:43.904732 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.904704    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 12:03:43.909108 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.909087    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 12:03:43.912360 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:43.912340    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 12:03:44.280640 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:44.280613    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:44.281001 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:44.280866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:44.281464 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:44.281449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:47.490764 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:47.490727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:03:49.158326 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:49.158293    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:49.158783 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:49.158502    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy" containerID="cri-o://3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b" gracePeriod=30
Jul 06 12:03:54.418175 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.418150    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:54.465398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465325    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465585 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465585 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465585 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465512    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465585 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9fjh\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465791 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465791 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465747    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:54.465903 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.465903 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465806    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:54.465903 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data\") pod \"dd426da4-2805-4003-8920-b6c2b37e0871\" (UID: \"dd426da4-2805-4003-8920-b6c2b37e0871\") "
Jul 06 12:03:54.466044 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.465940    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:03:54.466215 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466105    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:54.466349 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466291    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-credential-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.466349 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466314    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.466349 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466330    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd426da4-2805-4003-8920-b6c2b37e0871-istiod-ca-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.466349 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466343    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-workload-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.466989 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.466962    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:54.467624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.467602    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:03:54.467981 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.467963    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:03:54.468048 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.467980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:03:54.468099 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.468086    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh" (OuterVolumeSpecName: "kube-api-access-q9fjh") pod "dd426da4-2805-4003-8920-b6c2b37e0871" (UID: "dd426da4-2805-4003-8920-b6c2b37e0871"). InnerVolumeSpecName "kube-api-access-q9fjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:03:54.567552 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.567525    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-istio-token\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.567552 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.567550    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9fjh\" (UniqueName: \"kubernetes.io/projected/dd426da4-2805-4003-8920-b6c2b37e0871-kube-api-access-q9fjh\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.567721 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.567560    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-data\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.567721 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.567571    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd426da4-2805-4003-8920-b6c2b37e0871-istio-envoy\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:54.567721 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:54.567579    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd426da4-2805-4003-8920-b6c2b37e0871-istio-podinfo\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:03:55.152109 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.152077    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd426da4-2805-4003-8920-b6c2b37e0871" containerID="3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b" exitCode=0
Jul 06 12:03:55.152289 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.152124    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"
Jul 06 12:03:55.152289 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.152129    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerDied","Data":"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"}
Jul 06 12:03:55.152289 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.152204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh" event={"ID":"dd426da4-2805-4003-8920-b6c2b37e0871","Type":"ContainerDied","Data":"028ee5ab7ef6121144c8e8a9aaabf28c8a11433932ecad3916461262ec708f41"}
Jul 06 12:03:55.152289 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.152226    2581 scope.go:117] "RemoveContainer" containerID="3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"
Jul 06 12:03:55.161505 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.161482    2581 scope.go:117] "RemoveContainer" containerID="842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"
Jul 06 12:03:55.172021 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.171998    2581 scope.go:117] "RemoveContainer" containerID="3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"
Jul 06 12:03:55.172327 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:03:55.172309    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b\": container with ID starting with 3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b not found: ID does not exist" containerID="3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"
Jul 06 12:03:55.172462 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.172333    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b"} err="failed to get container status \"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b\": rpc error: code = NotFound desc = could not find container \"3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b\": container with ID starting with 3f0153effd6ad5934f91cb6636621bd83fffa6ec97105a4f21924af59fec1a5b not found: ID does not exist"
Jul 06 12:03:55.172462 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.172349    2581 scope.go:117] "RemoveContainer" containerID="842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"
Jul 06 12:03:55.172589 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:03:55.172571    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7\": container with ID starting with 842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7 not found: ID does not exist" containerID="842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"
Jul 06 12:03:55.172626 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.172595    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7"} err="failed to get container status \"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7\": rpc error: code = NotFound desc = could not find container \"842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7\": container with ID starting with 842f0df0e7d085b86543bcc23ee6180bb93a0505796e88c2cf60f1d4dfc9cca7 not found: ID does not exist"
Jul 06 12:03:55.173402 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.173385    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:55.176690 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.176671    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f43438-openshift-default-57b9c8d897-zjqsh"]
Jul 06 12:03:55.826898 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:55.826862    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" path="/var/lib/kubelet/pods/dd426da4-2805-4003-8920-b6c2b37e0871/volumes"
Jul 06 12:03:58.159304 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.159273    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:03:58.159752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.159637    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:03:58.159752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.159647    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:03:58.159752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.159721    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:03:58.159752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.159731    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:03:58.162486 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.162471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.166073 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.166052    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cf8c6a-openshift-default-dockercfg-gc2hr\""
Jul 06 12:03:58.178175 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.178155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:03:58.297220 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297385 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297385 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297385 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62xj\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.297652 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.297554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.398935 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.398909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399090 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.398944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399090 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.398961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62xj\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399090 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399294 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399294 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399294 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399294 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399501 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399563 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399619 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399566    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399708 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399681    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.399792 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.399776    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.400045 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.400023    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.401620 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.401601    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.401756 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.401740    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.407759 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.407734    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.407925 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.407904    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62xj\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj\") pod \"e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") " pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.472583 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.472510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:58.604777 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.604754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:03:58.607193 ip-10-0-138-178 kubenswrapper[2581]: W0706 12:03:58.607168    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1054d02c_feee_44cf_84b2_eacc412dec61.slice/crio-dc4dd258a85896acb76f81f6ce1cc940395bf01960e58ad3c53c347a2f64eb13 WatchSource:0}: Error finding container dc4dd258a85896acb76f81f6ce1cc940395bf01960e58ad3c53c347a2f64eb13: Status 404 returned error can't find the container with id dc4dd258a85896acb76f81f6ce1cc940395bf01960e58ad3c53c347a2f64eb13
Jul 06 12:03:58.609297 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.609262    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:58.609392 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.609327    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:58.609392 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:58.609354    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:03:59.173379 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:59.173339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerStarted","Data":"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"}
Jul 06 12:03:59.173763 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:59.173404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerStarted","Data":"dc4dd258a85896acb76f81f6ce1cc940395bf01960e58ad3c53c347a2f64eb13"}
Jul 06 12:03:59.193929 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:59.193869    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podStartSLOduration=1.193847745 podStartE2EDuration="1.193847745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:03:59.191403049 +0000 UTC m=+2115.902495579" watchObservedRunningTime="2026-07-06 12:03:59.193847745 +0000 UTC m=+2115.904940276"
Jul 06 12:03:59.473248 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:59.473175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:03:59.477939 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:03:59.477917    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:00.178593 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:00.178565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:00.179416 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:00.179398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:00.485814 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:00.485739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:04:14.193812 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:14.193773    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:04:15.742813 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:15.742779    2581 patch_prober.go:28] interesting pod/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:46450->10.133.0.40:15021: read: connection reset by peer" start-of-body=
Jul 06 12:04:15.743299 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:15.742844    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": read tcp 10.133.0.2:46450->10.133.0.40:15021: read: connection reset by peer"
Jul 06 12:04:16.261181 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.261122    2581 generic.go:356] "Generic (PLEG): container finished" podID="1054d02c-feee-44cf-84b2-eacc412dec61" containerID="89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5" exitCode=0
Jul 06 12:04:16.261357 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.261196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerDied","Data":"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"}
Jul 06 12:04:16.261558 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.261545    2581 scope.go:117] "RemoveContainer" containerID="89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"
Jul 06 12:04:16.262601 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.262573    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:04:16.262674 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.262656    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:04:16.262711 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:16.262699    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:04:17.268782 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:17.268746    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerStarted","Data":"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"}
Jul 06 12:04:17.472886 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:17.472852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:17.473096 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:17.473074    2581 patch_prober.go:28] interesting pod/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 12:04:17.473165 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:17.473124    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 12:04:18.472926 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:18.472886    2581 patch_prober.go:28] interesting pod/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 12:04:18.473446 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:18.472973    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 12:04:19.473708 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:19.473669    2581 patch_prober.go:28] interesting pod/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 12:04:19.474076 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:19.473739    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 12:04:20.473148 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:20.473093    2581 patch_prober.go:28] interesting pod/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 06 12:04:20.473331 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:20.473177    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 06 12:04:21.476595 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:21.476563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:21.477004 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:21.476984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:21.477564 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:21.477544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:04:46.392153 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:04:46.392098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:05:05.488829 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:05:05.488793    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:05:27.401651 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:05:27.401615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:05:45.620526 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:05:45.620486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:05:58.895734 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:05:58.895699    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:06:14.291711 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:06:14.291625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:06:31.721157 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:06:31.721110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:06:48.493162 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:06:48.493099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:07:03.223321 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:07:03.223282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:07:21.896426 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:07:21.896388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:07:44.198104 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:07:44.198014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:08:02.997561 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:02.997531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:08:23.697645 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:23.697611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:08:25.290150 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.290114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:08:25.290525 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.290505    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:08:25.290525 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.290518    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd426da4-2805-4003-8920-b6c2b37e0871" containerName="istio-proxy"
Jul 06 12:08:25.293421 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.293404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.296398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.296375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8b7fb6\"/\"rate-test-model-8b7fb6-kserve-self-signed-certs\""
Jul 06 12:08:25.296556 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.296376    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8b7fb6\"/\"default-dockercfg-nvbpw\""
Jul 06 12:08:25.296556 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.296429    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8b7fb6\"/\"openshift-service-ca.crt\""
Jul 06 12:08:25.296556 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.296430    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8b7fb6\"/\"kube-root-ca.crt\""
Jul 06 12:08:25.300072 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.300049    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:08:25.471205 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.471205 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdb8\" (UniqueName: \"kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.471420 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.471420 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.471420 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.471420 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.471337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572604 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572604 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572840 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572840 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdb8\" (UniqueName: \"kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572840 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.572840 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.572692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.573126 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.573021    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.573126 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.573073    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.573126 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.573096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.574861 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.574834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.575253 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.575230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.579916 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.579892    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdb8\" (UniqueName: \"kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8\") pod \"rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") " pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.603875 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.603855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:25.731195 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:25.731167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:08:25.733690 ip-10-0-138-178 kubenswrapper[2581]: W0706 12:08:25.733660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69348105_73c4_4246_a0af_092b91e8b6f9.slice/crio-c4293b3475f507f933fe26d964ba15788548d209139676fb04f8d5245b234fc5 WatchSource:0}: Error finding container c4293b3475f507f933fe26d964ba15788548d209139676fb04f8d5245b234fc5: Status 404 returned error can't find the container with id c4293b3475f507f933fe26d964ba15788548d209139676fb04f8d5245b234fc5
Jul 06 12:08:26.403369 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:26.403333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" event={"ID":"69348105-73c4-4246-a0af-092b91e8b6f9","Type":"ContainerStarted","Data":"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"}
Jul 06 12:08:26.403866 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:26.403381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" event={"ID":"69348105-73c4-4246-a0af-092b91e8b6f9","Type":"ContainerStarted","Data":"c4293b3475f507f933fe26d964ba15788548d209139676fb04f8d5245b234fc5"}
Jul 06 12:08:26.419018 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:26.418932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" podStartSLOduration=1.418916791 podStartE2EDuration="1.418916791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:08:26.418628159 +0000 UTC m=+2383.129720712" watchObservedRunningTime="2026-07-06 12:08:26.418916791 +0000 UTC m=+2383.130009331"
Jul 06 12:08:35.604387 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:35.604346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:35.604842 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:35.604409    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:35.617365 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:35.617335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:36.459876 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:36.459848    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:08:39.792398 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:39.792367    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:08:43.929198 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:43.929163    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 12:08:43.932568 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:43.932543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 12:08:43.940461 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:43.940444    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 12:08:43.943709 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:08:43.943693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vg4jb_a74f345f-87ae-4290-8ccd-2ddc378e7e9f/ovn-acl-logging/0.log"
Jul 06 12:09:13.491664 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:09:13.491622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:09:49.898055 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:09:49.898020    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:10:10.897145 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:10.897098    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:10:14.934484 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:14.934448    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:10:27.192278 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:27.192242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:10:29.954206 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:29.954131    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" podUID="69348105-73c4-4246-a0af-092b91e8b6f9" containerName="main" containerID="cri-o://c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504" gracePeriod=45
Jul 06 12:10:30.206056 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.206002    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:10:30.238691 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.238668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.238826 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.238703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxdb8\" (UniqueName: \"kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.238826 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.238727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.238826 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.238746    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.238826 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.238764    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.239051 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239000    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:10:30.239051 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239014    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:10:30.239179 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239163    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home\") pod \"69348105-73c4-4246-a0af-092b91e8b6f9\" (UID: \"69348105-73c4-4246-a0af-092b91e8b6f9\") "
Jul 06 12:10:30.239421 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239390    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home" (OuterVolumeSpecName: "home") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:10:30.239568 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239554    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-model-cache\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.239628 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239574    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-tmp-dir\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.239628 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.239586    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-home\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.241399 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.241370    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm" (OuterVolumeSpecName: "dshm") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:10:30.241503 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.241438    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8" (OuterVolumeSpecName: "kube-api-access-vxdb8") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "kube-api-access-vxdb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:10:30.241503 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.241471    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69348105-73c4-4246-a0af-092b91e8b6f9" (UID: "69348105-73c4-4246-a0af-092b91e8b6f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:10:30.340492 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.340469    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxdb8\" (UniqueName: \"kubernetes.io/projected/69348105-73c4-4246-a0af-092b91e8b6f9-kube-api-access-vxdb8\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.340492 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.340489    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69348105-73c4-4246-a0af-092b91e8b6f9-tls-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.340638 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.340498    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69348105-73c4-4246-a0af-092b91e8b6f9-dshm\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:10:30.981810 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.981777    2581 generic.go:356] "Generic (PLEG): container finished" podID="69348105-73c4-4246-a0af-092b91e8b6f9" containerID="c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504" exitCode=0
Jul 06 12:10:30.982238 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.981819    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"
Jul 06 12:10:30.982238 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.981863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" event={"ID":"69348105-73c4-4246-a0af-092b91e8b6f9","Type":"ContainerDied","Data":"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"}
Jul 06 12:10:30.982238 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.981908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5" event={"ID":"69348105-73c4-4246-a0af-092b91e8b6f9","Type":"ContainerDied","Data":"c4293b3475f507f933fe26d964ba15788548d209139676fb04f8d5245b234fc5"}
Jul 06 12:10:30.982238 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.981931    2581 scope.go:117] "RemoveContainer" containerID="c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"
Jul 06 12:10:30.990947 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.990925    2581 scope.go:117] "RemoveContainer" containerID="c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"
Jul 06 12:10:30.991202 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:10:30.991183    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504\": container with ID starting with c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504 not found: ID does not exist" containerID="c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"
Jul 06 12:10:30.991280 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:30.991214    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504"} err="failed to get container status \"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504\": rpc error: code = NotFound desc = could not find container \"c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504\": container with ID starting with c07c1f707e16611ff813705aeaf26b733ec15eada5b703f256217011dc5c2504 not found: ID does not exist"
Jul 06 12:10:31.001116 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:31.001094    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:10:31.004814 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:31.004793    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8b7fb6/rate-test-model-8b7fb6-kserve-8688569cc5-rdwn5"]
Jul 06 12:10:31.826607 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:10:31.826565    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69348105-73c4-4246-a0af-092b91e8b6f9" path="/var/lib/kubelet/pods/69348105-73c4-4246-a0af-092b91e8b6f9/volumes"
Jul 06 12:11:03.193261 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:03.193226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6shsn"]
Jul 06 12:11:06.677055 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:06.677016    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:11:06.677545 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:06.677234    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy" containerID="cri-o://2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0" gracePeriod=30
Jul 06 12:11:11.931703 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.931677    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:11:11.994381 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994381 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994381 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s62xj\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994419    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994475    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994530    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994587    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token\") pod \"1054d02c-feee-44cf-84b2-eacc412dec61\" (UID: \"1054d02c-feee-44cf-84b2-eacc412dec61\") "
Jul 06 12:11:11.994642 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994626    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:11:11.995017 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994924    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-certs\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:11.995017 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.994983    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:11:11.995312 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.995276    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:11:11.995475 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.995386    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data" (OuterVolumeSpecName: "istio-data") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:11:11.995550 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.995473    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:11:11.996542 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.996521    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:11:11.996730 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.996706    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj" (OuterVolumeSpecName: "kube-api-access-s62xj") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "kube-api-access-s62xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:11:11.996730 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.996712    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 12:11:11.997231 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:11.997202    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token" (OuterVolumeSpecName: "istio-token") pod "1054d02c-feee-44cf-84b2-eacc412dec61" (UID: "1054d02c-feee-44cf-84b2-eacc412dec61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:11:12.095700 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095676    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s62xj\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-kube-api-access-s62xj\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095700 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095699    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-data\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095708    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1054d02c-feee-44cf-84b2-eacc412dec61-istio-podinfo\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095716    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1054d02c-feee-44cf-84b2-eacc412dec61-istiod-ca-cert\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095724    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-workload-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095733    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1054d02c-feee-44cf-84b2-eacc412dec61-istio-token\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095740    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-istio-envoy\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.095839 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.095750    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1054d02c-feee-44cf-84b2-eacc412dec61-credential-socket\") on node \"ip-10-0-138-178.ec2.internal\" DevicePath \"\""
Jul 06 12:11:12.168172 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.168121    2581 generic.go:356] "Generic (PLEG): container finished" podID="1054d02c-feee-44cf-84b2-eacc412dec61" containerID="2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0" exitCode=0
Jul 06 12:11:12.168300 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.168173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerDied","Data":"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"}
Jul 06 12:11:12.168300 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.168197    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"
Jul 06 12:11:12.168300 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.168244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck" event={"ID":"1054d02c-feee-44cf-84b2-eacc412dec61","Type":"ContainerDied","Data":"dc4dd258a85896acb76f81f6ce1cc940395bf01960e58ad3c53c347a2f64eb13"}
Jul 06 12:11:12.168300 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.168277    2581 scope.go:117] "RemoveContainer" containerID="2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"
Jul 06 12:11:12.176854 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.176836    2581 scope.go:117] "RemoveContainer" containerID="89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"
Jul 06 12:11:12.184199 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.184182    2581 scope.go:117] "RemoveContainer" containerID="2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"
Jul 06 12:11:12.184420 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:11:12.184403    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0\": container with ID starting with 2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0 not found: ID does not exist" containerID="2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"
Jul 06 12:11:12.184473 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.184428    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0"} err="failed to get container status \"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0\": rpc error: code = NotFound desc = could not find container \"2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0\": container with ID starting with 2649b13c612c93199120b682d0a1c57d9df90fe52c16e663d1d6ddb0929a87a0 not found: ID does not exist"
Jul 06 12:11:12.184473 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.184443    2581 scope.go:117] "RemoveContainer" containerID="89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"
Jul 06 12:11:12.184675 ip-10-0-138-178 kubenswrapper[2581]: E0706 12:11:12.184656    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5\": container with ID starting with 89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5 not found: ID does not exist" containerID="89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"
Jul 06 12:11:12.184739 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.184681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5"} err="failed to get container status \"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5\": rpc error: code = NotFound desc = could not find container \"89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5\": container with ID starting with 89999ea4853fe4be324f061eac1625d83c63e3627d95142dfef9e8d95630bcf5 not found: ID does not exist"
Jul 06 12:11:12.188283 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.188264    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:11:12.191485 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.191465    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cf8c6a-openshift-default-5548fd9c75-6mtck"]
Jul 06 12:11:12.878477 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.878450    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb7946974-h4ksh_d9e53451-8dfe-4d61-8b62-ce5dfd998597/copy-manifests/0.log"
Jul 06 12:11:12.885489 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:12.885467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb7946974-h4ksh_d9e53451-8dfe-4d61-8b62-ce5dfd998597/manager/0.log"
Jul 06 12:11:13.251761 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:13.251736    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6hvkc_ec13e12e-701c-492b-8437-632931af964b/postgres/0.log"
Jul 06 12:11:13.826170 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:13.826121    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" path="/var/lib/kubelet/pods/1054d02c-feee-44cf-84b2-eacc412dec61/volumes"
Jul 06 12:11:14.951278 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:14.951251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9krkg_c28b1ee8-78b4-4667-ae04-151c3b38ee5f/kuadrant-console-plugin/0.log"
Jul 06 12:11:15.081073 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:15.081046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8t88w_7f462938-b20a-4eb6-91a8-dd2810fa6ca0/registry-server/0.log"
Jul 06 12:11:15.325274 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:15.325251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6shsn_2b6d525c-e8b0-4946-9879-9a939ae52165/limitador/0.log"
Jul 06 12:11:15.445533 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:15.445504    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4k7jz_843ef1db-219d-4669-811e-8ae5a06568de/manager/0.log"
Jul 06 12:11:16.269531 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:16.269503    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/1.log"
Jul 06 12:11:16.518304 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:16.518274    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbdh8_30b092d1-18e2-43c1-965b-68cd18dd00a0/payload-processing/0.log"
Jul 06 12:11:16.629703 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:16.629621    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcd969f-ztlsf_996975a6-fea7-4424-9809-d98eb0d840c9/router/0.log"
Jul 06 12:11:17.096537 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:17.096500    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-clxv7_cc854a3c-0307-44d0-8ec3-d7c8c535b80b/main/0.log"
Jul 06 12:11:17.433951 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:17.433858    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mcbvc_f0e4dfd6-77b2-4b43-bea4-9b7c567f17d3/main/0.log"
Jul 06 12:11:24.979730 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:24.979694    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qzr6n_3db4e29d-85fe-42e9-b0c1-41bb0943d974/global-pull-secret-syncer/0.log"
Jul 06 12:11:25.071836 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:25.071808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdjsz_5159d19a-7f5e-44c1-b602-99f67c1370cf/konnectivity-agent/0.log"
Jul 06 12:11:25.163186 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:25.163120    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-178.ec2.internal_6e91ce37bfe25d5bab02452089d06221/haproxy/0.log"
Jul 06 12:11:30.335862 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:30.335788    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9krkg_c28b1ee8-78b4-4667-ae04-151c3b38ee5f/kuadrant-console-plugin/0.log"
Jul 06 12:11:30.386957 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:30.386929    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8t88w_7f462938-b20a-4eb6-91a8-dd2810fa6ca0/registry-server/0.log"
Jul 06 12:11:30.610755 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:30.610675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6shsn_2b6d525c-e8b0-4946-9879-9a939ae52165/limitador/0.log"
Jul 06 12:11:30.713115 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:30.713083    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4k7jz_843ef1db-219d-4669-811e-8ae5a06568de/manager/0.log"
Jul 06 12:11:32.709758 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:32.709733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6pql6_473c4572-96af-455e-8259-582aa62cb589/node-exporter/0.log"
Jul 06 12:11:32.737674 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:32.737648    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6pql6_473c4572-96af-455e-8259-582aa62cb589/kube-rbac-proxy/0.log"
Jul 06 12:11:32.759942 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:32.759925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6pql6_473c4572-96af-455e-8259-582aa62cb589/init-textfile/0.log"
Jul 06 12:11:33.030222 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.030194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/prometheus/0.log"
Jul 06 12:11:33.051299 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.051280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/config-reloader/0.log"
Jul 06 12:11:33.075032 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.075009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/thanos-sidecar/0.log"
Jul 06 12:11:33.105502 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.105481    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/kube-rbac-proxy-web/0.log"
Jul 06 12:11:33.132637 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.132609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/kube-rbac-proxy/0.log"
Jul 06 12:11:33.156601 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.156583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/kube-rbac-proxy-thanos/0.log"
Jul 06 12:11:33.183152 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.183117    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_decc6ce1-2226-4db5-89b8-f6f149c4bdbf/init-config-reloader/0.log"
Jul 06 12:11:33.213287 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.213251    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sdxz2_16791b27-27a9-4fb3-bbf4-0e846a603aa0/prometheus-operator/0.log"
Jul 06 12:11:33.232101 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.232082    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sdxz2_16791b27-27a9-4fb3-bbf4-0e846a603aa0/kube-rbac-proxy/0.log"
Jul 06 12:11:33.256779 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:33.256756    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-8nx4t_9bb56472-2da3-44fc-b899-e9d00164cca3/prometheus-operator-admission-webhook/0.log"
Jul 06 12:11:34.404390 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404357    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"]
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404690    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69348105-73c4-4246-a0af-092b91e8b6f9" containerName="main"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404700    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="69348105-73c4-4246-a0af-092b91e8b6f9" containerName="main"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404713    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404719    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404783    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404790    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1054d02c-feee-44cf-84b2-eacc412dec61" containerName="istio-proxy"
Jul 06 12:11:34.404830 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.404800    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="69348105-73c4-4246-a0af-092b91e8b6f9" containerName="main"
Jul 06 12:11:34.407746 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.407727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.410188 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.410167    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzjtz\"/\"openshift-service-ca.crt\""
Jul 06 12:11:34.410299 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.410273    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qzjtz\"/\"default-dockercfg-jkctc\""
Jul 06 12:11:34.410935 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.410921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzjtz\"/\"kube-root-ca.crt\""
Jul 06 12:11:34.415614 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.415594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"]
Jul 06 12:11:34.491503 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.491479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-podres\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.491624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.491521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-proc\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.491624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.491539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-sys\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.491624 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.491620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvbs\" (UniqueName: \"kubernetes.io/projected/4f211d58-c322-4864-acd5-568354a09806-kube-api-access-rcvbs\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.491767 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.491677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-lib-modules\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592418 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvbs\" (UniqueName: \"kubernetes.io/projected/4f211d58-c322-4864-acd5-568354a09806-kube-api-access-rcvbs\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592571 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-lib-modules\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592571 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-podres\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592571 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-proc\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592571 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-sys\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592737 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-lib-modules\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592737 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592618    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-proc\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592737 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592628    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-sys\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.592737 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.592639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f211d58-c322-4864-acd5-568354a09806-podres\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.600179 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.600131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvbs\" (UniqueName: \"kubernetes.io/projected/4f211d58-c322-4864-acd5-568354a09806-kube-api-access-rcvbs\") pod \"perf-node-gather-daemonset-mch7p\" (UID: \"4f211d58-c322-4864-acd5-568354a09806\") " pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.719038 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.718972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:34.846928 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:34.846903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"]
Jul 06 12:11:34.848869 ip-10-0-138-178 kubenswrapper[2581]: W0706 12:11:34.848844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f211d58_c322_4864_acd5_568354a09806.slice/crio-e2be62ceddd48795f65c0f7a31a6c4e2d6c46815d1c095188388cb4818ed2e5e WatchSource:0}: Error finding container e2be62ceddd48795f65c0f7a31a6c4e2d6c46815d1c095188388cb4818ed2e5e: Status 404 returned error can't find the container with id e2be62ceddd48795f65c0f7a31a6c4e2d6c46815d1c095188388cb4818ed2e5e
Jul 06 12:11:35.276151 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.276109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p" event={"ID":"4f211d58-c322-4864-acd5-568354a09806","Type":"ContainerStarted","Data":"72fcd1146e8a273b0173fd471f105cea20a0a61a6755e48af8967876fef409a9"}
Jul 06 12:11:35.276336 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.276190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p" event={"ID":"4f211d58-c322-4864-acd5-568354a09806","Type":"ContainerStarted","Data":"e2be62ceddd48795f65c0f7a31a6c4e2d6c46815d1c095188388cb4818ed2e5e"}
Jul 06 12:11:35.276336 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.276233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:35.293263 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.293216    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p" podStartSLOduration=1.293201128 podStartE2EDuration="1.293201128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:11:35.29170902 +0000 UTC m=+2572.002801550" watchObservedRunningTime="2026-07-06 12:11:35.293201128 +0000 UTC m=+2572.004293657"
Jul 06 12:11:35.365089 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.365054    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/1.log"
Jul 06 12:11:35.373279 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:35.373258    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q4xh2_1c8c16d9-3863-4a7b-a4ba-1ae683202eec/console-operator/2.log"
Jul 06 12:11:36.456021 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:36.455987    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-4jm4j_2ddef93e-ff31-4e7c-a8ad-2b78daed60b3/volume-data-source-validator/0.log"
Jul 06 12:11:37.598037 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:37.598006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfvb2_5c5523c3-3880-4183-a80a-d40eb0d9057e/dns/0.log"
Jul 06 12:11:37.621055 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:37.621027    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qfvb2_5c5523c3-3880-4183-a80a-d40eb0d9057e/kube-rbac-proxy/0.log"
Jul 06 12:11:37.704168 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:37.702389    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fskrh_a443af82-1b06-45a9-93cd-13f87a30384e/dns-node-resolver/0.log"
Jul 06 12:11:38.251905 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:38.251875    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c74797bf4-mw8xb_64f3ecc1-7aed-47ae-8510-9c55bf693378/registry/0.log"
Jul 06 12:11:38.276644 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:38.276620    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pjf4_d2d8b0c8-c11a-4c74-a235-c128d84e70e2/node-ca/0.log"
Jul 06 12:11:39.547444 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:39.547414    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/0.log"
Jul 06 12:11:39.602190 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:39.602162    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/1.log"
Jul 06 12:11:39.715513 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:39.715486    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbdh8_30b092d1-18e2-43c1-965b-68cd18dd00a0/payload-processing/0.log"
Jul 06 12:11:39.738934 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:39.738900    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcd969f-ztlsf_996975a6-fea7-4424-9809-d98eb0d840c9/router/0.log"
Jul 06 12:11:40.406777 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:40.406747    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5rs27_fdd68d20-dacd-4262-831b-1d3c947289a9/serve-healthcheck-canary/0.log"
Jul 06 12:11:40.945403 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:40.945376    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxqtx_9c1659c4-3dbb-4036-bdd1-62177f5ff7dc/kube-rbac-proxy/0.log"
Jul 06 12:11:40.966938 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:40.966915    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxqtx_9c1659c4-3dbb-4036-bdd1-62177f5ff7dc/exporter/0.log"
Jul 06 12:11:40.988131 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:40.988102    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxqtx_9c1659c4-3dbb-4036-bdd1-62177f5ff7dc/extractor/0.log"
Jul 06 12:11:41.290706 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:41.290677    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qzjtz/perf-node-gather-daemonset-mch7p"
Jul 06 12:11:43.806996 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:43.806968    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb7946974-h4ksh_d9e53451-8dfe-4d61-8b62-ce5dfd998597/manager/0.log"
Jul 06 12:11:43.828485 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:43.828467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cb7946974-h4ksh_d9e53451-8dfe-4d61-8b62-ce5dfd998597/copy-manifests/0.log"
Jul 06 12:11:44.050961 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:44.050939    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-6hvkc_ec13e12e-701c-492b-8437-632931af964b/postgres/0.log"
Jul 06 12:11:44.540752 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:44.540721    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/0.log"
Jul 06 12:11:44.591722 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:44.591688    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/1.log"
Jul 06 12:11:44.765530 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:44.765502    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbdh8_30b092d1-18e2-43c1-965b-68cd18dd00a0/payload-processing/0.log"
Jul 06 12:11:44.780220 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:44.780193    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcd969f-ztlsf_996975a6-fea7-4424-9809-d98eb0d840c9/router/0.log"
Jul 06 12:11:45.556957 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:45.556930    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758cc6698f-bnqdv_416cf0ec-7471-42d5-bfa6-de4b69be8efd/manager/0.log"
Jul 06 12:11:46.333590 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:46.333547    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/0.log"
Jul 06 12:11:46.388601 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:46.388568    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-xk8vw_4b1951ae-1b6a-425a-98c5-d83539d526b1/istio-proxy/1.log"
Jul 06 12:11:46.477986 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:46.477955    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbdh8_30b092d1-18e2-43c1-965b-68cd18dd00a0/payload-processing/0.log"
Jul 06 12:11:46.493279 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:46.493254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcd969f-ztlsf_996975a6-fea7-4424-9809-d98eb0d840c9/router/0.log"
Jul 06 12:11:52.171550 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.171520    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/kube-multus-additional-cni-plugins/0.log"
Jul 06 12:11:52.192963 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.192939    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/egress-router-binary-copy/0.log"
Jul 06 12:11:52.218808 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.218789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/cni-plugins/0.log"
Jul 06 12:11:52.240335 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.240310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/bond-cni-plugin/0.log"
Jul 06 12:11:52.263643 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.263624    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/routeoverride-cni/0.log"
Jul 06 12:11:52.284959 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.284942    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/whereabouts-cni-bincopy/0.log"
Jul 06 12:11:52.307343 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.307329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmbl7_e81213a7-0dcf-4d59-93f2-34481ca0422a/whereabouts-cni/0.log"
Jul 06 12:11:52.344966 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.344948    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jsqlb_06427b2e-02c1-4ee1-a201-53538c2891f2/kube-multus/0.log"
Jul 06 12:11:52.535202 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.535177    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v489s_acc3219a-f3b6-4711-82d3-73c72b3fe824/network-metrics-daemon/0.log"
Jul 06 12:11:52.553827 ip-10-0-138-178 kubenswrapper[2581]: I0706 12:11:52.553807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v489s_acc3219a-f3b6-4711-82d3-73c72b3fe824/kube-rbac-proxy/0.log"