Jul 06 19:30:40.515777 ip-10-0-135-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:30:40.515923 ip-10-0-135-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:30:40.515941 ip-10-0-135-8 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:30:40.516280 ip-10-0-135-8 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:30:50.765086 ip-10-0-135-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:30:50.765109 ip-10-0-135-8 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5ee54e5c47da474ea6918630ee7a2701 --
Jul 06 19:32:50.056765 ip-10-0-135-8 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.484596    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490415    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490430    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490433    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490436    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490440    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490443    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490446    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:50.518007 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490449    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490452    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490455    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490458    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490461    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490464    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490481    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490485    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490487    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490491    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490498    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490502    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490504    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490507    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490509    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490512    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490515    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490518    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490522    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:50.518836 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490526    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490529    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490532    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490535    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490538    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490540    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490543    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490547    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490549    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490552    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490554    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490557    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490560    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490562    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490565    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490567    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490570    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490573    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490576    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490579    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:50.519462 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490581    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490584    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490586    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490589    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490591    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490594    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490596    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490599    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490601    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490604    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490606    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490609    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490611    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490614    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490618    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490622    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490625    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490629    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490631    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490634    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:50.520620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490637    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490639    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490642    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490644    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490648    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490650    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490653    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490656    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490658    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490661    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490664    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490667    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490669    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490672    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490674    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490677    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490679    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490682    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490684    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490686    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:50.521216 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490689    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490691    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490694    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490697    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490699    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490702    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490706    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490709    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490712    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490715    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490718    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490721    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.490723    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491496    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491506    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491512    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491515    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491520    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:50.521786 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491524    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491528    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491531    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491534    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491538    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491542    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491545    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491547    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491550    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491553    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491556    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491558    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491561    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491563    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491566    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491570    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491573    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491575    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491578    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491581    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:50.522366 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491583    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491586    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491588    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491591    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491594    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491596    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491599    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491601    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491604    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491606    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491609    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491612    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491615    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491617    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491620    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491623    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491625    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491628    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491630    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491633    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:50.522998 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491635    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491638    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491641    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491643    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491646    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491648    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491651    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491653    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491656    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491658    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491661    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491663    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491666    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491668    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491671    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491673    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491675    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491678    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491681    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:50.523638 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491683    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491686    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491689    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491692    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491695    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491697    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491700    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491703    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491705    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491708    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491710    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491713    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491716    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491718    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491720    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491723    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491727    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491730    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491733    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491735    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:50.524341 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491738    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491741    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491743    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491745    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491748    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491750    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491753    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491755    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491758    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491761    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491763    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491766    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491768    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491771    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.491774    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492156    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492161    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492164    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492167    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492170    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:50.524923 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492173    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492177    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492182    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492185    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492188    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492191    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492194    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492197    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492200    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492202    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492205    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492208    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492210    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492213    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492216    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492218    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492223    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492226    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492229    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:50.525591 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492232    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492235    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492238    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492241    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492244    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492247    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492250    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492252    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492255    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492257    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492260    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492262    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492265    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492268    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492270    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492274    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492277    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492279    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492282    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:50.526240 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492285    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492288    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492290    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492293    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492296    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492298    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492301    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492303    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492305    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492308    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492311    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492313    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492316    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492318    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492321    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492323    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492326    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492328    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492331    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492334    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:51.723035 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492336    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:50.568163 ip-10-0-135-8 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492339    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492342    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492344    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492347    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492350    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492352    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492355    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492357    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492363    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492366    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492368    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492371    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492374    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492377    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492379    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492381    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492385    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492388    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492390    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:51.724847 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492393    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492397    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492400    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492403    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492405    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492408    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492411    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492413    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492416    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492418    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492421    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492423    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492426    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492429    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492431    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.492434    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492521    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492528    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492534    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492539    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492543    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:32:51.726169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492548    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492552    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492562    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492566    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492569    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492573    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492577    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492580    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492583    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492586    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492589    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492591    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492594    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492598    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492601    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492604    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492608    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492612    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492616    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492621    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492624    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492627    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492630    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492633    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:32:51.727232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492636    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492639    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492642    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492647    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492650    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492652    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492655    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492658    2578 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492663    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492667    2578 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492670    2578 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492673    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492676    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492680    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492683    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492686    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492689    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492692    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492695    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492697    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492701    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492703    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492706    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492709    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492712    2578 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:32:51.728278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492716    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492719    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492723    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492726    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492730    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492733    2578 flags.go:64] FLAG: --help="false"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492736    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492739    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492742    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492745    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492748    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492752    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492754    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492757    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492760    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492764    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492767    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492770    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492773    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492776    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492779    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492783    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492786    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492788    2578 flags.go:64] FLAG: --lock-file=""
Jul 06 19:32:51.729802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492791    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492794    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492797    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492802    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492805    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492808    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492811    2578 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492813    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492817    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492820    2578 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492824    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492828    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492831    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492835    2578 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492838    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492841    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492844    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492847    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492850    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492852    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492855    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492862    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492865    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492869    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:32:51.731969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492872    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492875    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492881    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492884    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492887    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492890    2578 flags.go:64] FLAG: --port="10250"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492893    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492896    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-096e41ba42c71edfc"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492900    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492903    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492906    2578 flags.go:64] FLAG: --register-node="true"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492909    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492912    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492915    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492918    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492920    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492924    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492928    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492932    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492935    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492938    2578 flags.go:64] FLAG: --runonce="false"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492941    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492944    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492947    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492950    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:32:51.748713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492953    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492956    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492959    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492962    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492965    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492968    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492970    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492974    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492977    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492980    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492983    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492988    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492991    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492994    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.492998    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493000    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493003    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493006    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493009    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493012    2578 flags.go:64] FLAG: --v="2"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493016    2578 flags.go:64] FLAG: --version="false"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493020    2578 flags.go:64] FLAG: --vmodule=""
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493024    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.493028    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493154    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:51.749655 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493159    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493162    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493165    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493168    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493171    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493173    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493176    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493179    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493181    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493184    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493186    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493189    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493192    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493194    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493198    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493201    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493203    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493206    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493209    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493211    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:51.750517 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493214    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493216    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493219    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493222    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493225    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493228    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493232    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493235    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493237    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493240    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493242    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493245    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493248    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493251    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493254    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493256    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493259    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493261    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493264    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493267    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:51.751144 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493270    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493272    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493274    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493277    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493280    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493282    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493286    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493289    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493291    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493294    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493297    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493300    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493302    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493305    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493308    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493311    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493313    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493316    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493318    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493321    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:51.751816 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493326    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493329    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493331    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493335    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493338    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493340    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493344    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493348    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493351    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493354    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493356    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493359    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493361    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493364    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493366    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493383    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493387    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493391    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:51.752595 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493394    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493397    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493400    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493403    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493406    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493408    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493411    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493414    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493416    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493419    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493423    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493427    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493430    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493432    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493435    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493438    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493440    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493444    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:51.753158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.493447    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.494060    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.504242    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.504260    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.504279    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.504285    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504625    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504641    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504646    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504651    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504656    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504660    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504665    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504670    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504674    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:51.753815 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504685    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504689    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504693    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504698    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504702    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504706    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504711    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504715    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504720    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504724    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504728    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504732    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504739    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504752    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504758    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504763    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504768    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504773    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504778    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:51.754787 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504784    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504789    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504794    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504798    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504803    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504813    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504818    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504824    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504830    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504834    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504841    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504846    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504851    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504856    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504861    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504865    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504869    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504880    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504884    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:51.756198 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504889    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504894    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504899    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504903    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504907    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504912    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504916    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504920    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504924    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504929    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504933    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504943    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504947    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504955    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504960    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504965    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504969    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504973    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504977    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504982    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:51.756989 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504986    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504990    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.504995    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505004    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505011    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505016    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505020    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505024    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505028    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505032    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505036    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505040    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505044    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505048    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505053    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505057    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505066    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505070    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505074    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505078    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:51.757620 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505082    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505087    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505091    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505095    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505099    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505106    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505110    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505114    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505118    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505126    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505130    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505134    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.505143    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505603    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505618    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:32:51.758168 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505622    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505626    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505628    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505631    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505634    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505637    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505640    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505642    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505645    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505647    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505650    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505653    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505656    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505659    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505662    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505665    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505668    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505671    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505674    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:32:51.758646 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505676    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505679    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505682    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505685    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505688    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505690    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505693    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505696    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505699    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505701    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505704    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505707    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505710    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505712    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505715    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505717    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505720    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505723    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505727    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505732    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:32:51.759261 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505735    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505738    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505740    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505743    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505746    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505749    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505752    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505754    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505757    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505759    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505762    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505764    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505767    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505769    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505772    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505775    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505779    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505783    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505785    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505788    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:32:51.759901 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505790    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505793    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505796    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505799    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505801    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505804    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505807    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505810    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505812    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505815    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505818    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505820    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505823    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505826    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505828    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505831    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505833    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505837    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505841    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:32:51.760448 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505844    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505847    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505851    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505854    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505857    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505860    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505862    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505865    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505867    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505870    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505872    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505875    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505877    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505880    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505883    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505885    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505888    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505891    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:32:51.761021 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:50.505893    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.505898    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.506029    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.508250    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.509599    2578 server.go:1019] "Starting client certificate rotation"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.509697    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.509735    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.512264    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.513832    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.525465    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.531270    2578 log.go:25] "Validated CRI v1 image API"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.534104    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:32:51.761656 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.536424    2578 fs.go:135] Filesystem UUIDs: map[42e7393d-e0e9-4849-9c9e-e969636e4820:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f73d401a-0cbf-4fbe-87c3-8af0d36f394a:/dev/nvme0n1p4]
Jul 06 19:32:51.762058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.536439    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:32:51.762058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.541508    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.543225    2578 manager.go:216] Machine: {Timestamp:2026-07-06 19:32:50.541773054 +0000 UTC m=+0.364239969 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095471 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28fbef97afdf2925aac04693d94a53 SystemUUID:ec28fbef-97af-df29-25aa-c04693d94a53 BootID:5ee54e5c-47da-474e-a691-8630ee7a2701 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:cc:cc:e1:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:cc:cc:e1:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:15:24:95:d7:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.543331    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.543419    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.548091    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.548124    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.549604    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.549615    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.549623    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.549636    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.550910    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554010    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554149    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554178    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554188    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554208    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554218    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554228    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:32:51.762287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554603    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.554618    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.558967    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.561432    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.561483    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562517    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562533    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562542    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562551    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562564    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562571    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562582    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562590    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562601    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562609    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562620    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.562628    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.564076    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.564087    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.564884    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.564903    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.567280    2578 server.go:1268] "Started kubelet"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.567377    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.567486    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.567585    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.568738    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.569550    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.569963    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.573254    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z48qn"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.573736    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.573746    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.573785    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.573810    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574339    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574358    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574371    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574452    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574460    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574752    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574768    2578 factory.go:55] Registering systemd factory
Jul 06 19:32:51.962416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.574778    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.574185    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-8.ec2.internal.18bfca43ee09f6cc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-8.ec2.internal,UID:ip-10-0-135-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-8.ec2.internal,},FirstTimestamp:2026-07-06 19:32:50.567255756 +0000 UTC m=+0.389722671,LastTimestamp:2026-07-06 19:32:50.567255756 +0000 UTC m=+0.389722671,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-8.ec2.internal,}"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.576278    2578 factory.go:153] Registering CRI-O factory
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.576293    2578 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.576313    2578 factory.go:103] Registering Raw factory
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.576333    2578 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.576764    2578 manager.go:349] Starting recovery of all containers
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.579274    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:50.579289    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.581619    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z48qn"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.588162    2578 manager.go:354] Recovery completed
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.592403    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.594389    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.594422    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:50.594436    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630070    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630080    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630083    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630096    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630712    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630739    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.630751    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.631192    2578 policy_none.go:49] "None policy: Start"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.631210    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.631226    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.631542    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-8.ec2.internal.18bfca43efa83c04  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-8.ec2.internal,UID:ip-10-0-135-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-8.ec2.internal,},FirstTimestamp:2026-07-06 19:32:50.59440538 +0000 UTC m=+0.416872297,LastTimestamp:2026-07-06 19:32:50.59440538 +0000 UTC m=+0.416872297,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-8.ec2.internal,}"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.632714    2578 policy_none.go:47] "Start"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667220    2578 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.667263    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667273    2578 server.go:87] "Starting device plugin registration server"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667537    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667567    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667655    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667737    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.667747    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:32:51.963652 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.668260    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.668303    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.768670    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.769774    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.769802    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.769812    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.769845    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.787683    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.787713    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-8.ec2.internal\": node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.819232    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.831159    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.832335    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.832375    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.832400    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.832433    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.836086    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.920040    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.933188    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"]
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.933257    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.934441    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.934469    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.934500    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.935679    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.935783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.935825    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936433    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936463    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936433    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936490    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936511    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.936522    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.938274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.938297    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.938921    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.938952    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:51.938963    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.957011    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-8.ec2.internal\" not found" node="ip-10-0-135-8.ec2.internal"
Jul 06 19:32:51.964726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:51.960598    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-8.ec2.internal\" not found" node="ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.186133 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:52.020279    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:52.186133 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.110701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/900304adc0a22b16c5b55433db5b23be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-8.ec2.internal\" (UID: \"900304adc0a22b16c5b55433db5b23be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.186133 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.110745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.186133 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.110762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.186133 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:52.121043    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211503    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211597    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97735e9d98280d40d4e83cd0f2003464-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal\" (UID: \"97735e9d98280d40d4e83cd0f2003464\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/900304adc0a22b16c5b55433db5b23be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-8.ec2.internal\" (UID: \"900304adc0a22b16c5b55433db5b23be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.211634    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/900304adc0a22b16c5b55433db5b23be-config\") pod \"kube-apiserver-proxy-ip-10-0-135-8.ec2.internal\" (UID: \"900304adc0a22b16c5b55433db5b23be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:52.221522    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.259700    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.263496    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.386115 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:52.322167    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:52.422706    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-8.ec2.internal\" not found"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.428047    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.509442    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.517398    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.519369    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.530294    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.541180    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.545064    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.545184    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:32:52.578846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.545223    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.589843    2578 apiserver.go:52] "Watching apiserver"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.592921    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.595031    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal"]
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.609162    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.609574    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.620769    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:27:51 +0000 UTC" deadline="2028-03-07 05:27:12.216160852 +0000 UTC"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.620792    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14625h54m19.595372265s"
Jul 06 19:32:52.757548 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.620940    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:32:52.933577 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:52.877203    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900304adc0a22b16c5b55433db5b23be.slice/crio-a443cf0f9cdf3d85fce819372629f8e2716ccde888ab47dfd20d1aa46f024cf3 WatchSource:0}: Error finding container a443cf0f9cdf3d85fce819372629f8e2716ccde888ab47dfd20d1aa46f024cf3: Status 404 returned error can't find the container with id a443cf0f9cdf3d85fce819372629f8e2716ccde888ab47dfd20d1aa46f024cf3
Jul 06 19:32:52.933577 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:52.877520    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97735e9d98280d40d4e83cd0f2003464.slice/crio-a01eb95e6c26d7638468b96bb17cbc46ad9bcb86824ac66ad92b199eb3ac1405 WatchSource:0}: Error finding container a01eb95e6c26d7638468b96bb17cbc46ad9bcb86824ac66ad92b199eb3ac1405: Status 404 returned error can't find the container with id a01eb95e6c26d7638468b96bb17cbc46ad9bcb86824ac66ad92b199eb3ac1405
Jul 06 19:32:52.933577 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.886351    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:32:53.128555 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:52.952251    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:53.128555 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.029469    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sz5xv"
Jul 06 19:32:53.128555 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.038068    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sz5xv"
Jul 06 19:32:53.411963 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.411926    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kcb9m"]
Jul 06 19:32:53.414488 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.414451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.415770 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.415367    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nr9l6"]
Jul 06 19:32:53.418989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.418886    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-j5xc7"]
Jul 06 19:32:53.419373 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8532c2b0-ae47-453d-9d0c-fe9c4512890d-agent-certs\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.419449 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8532c2b0-ae47-453d-9d0c-fe9c4512890d-konnectivity-ca\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.419573 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419552    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:32:53.419682 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2mhlq\""
Jul 06 19:32:53.419770 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419747    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:32:53.419881 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419836    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:53.419985 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.419930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.420043 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.420014    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:32:53.421284 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.421268    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-64mk7"]
Jul 06 19:32:53.422147 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.421394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424212    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wckz5"]
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424271    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pc8r2\""
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.424920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.424987 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.424959    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:32:53.427340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.426698    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-ffk8d"]
Jul 06 19:32:53.428273 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.428200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:53.428273 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.428262    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:32:53.429014 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.428962    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"]
Jul 06 19:32:53.429181 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.429121    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.431646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.431435    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-phwsv"]
Jul 06 19:32:53.431646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.431452    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.432071 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.432048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rk54j\""
Jul 06 19:32:53.432364 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.432322    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:32:53.432444 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.432384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.432925 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.432556    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.433156 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.433139    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:32:53.434233 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.433751    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-6rfnr"]
Jul 06 19:32:53.434233 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.434113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.435127 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.435106    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:32:53.435216 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.435115    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ww8w7\""
Jul 06 19:32:53.435216 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.435187    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.435374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.435345    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.436121 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.436099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-nnk76"]
Jul 06 19:32:53.438930 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.437094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.438930 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.438765    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4j8cn"]
Jul 06 19:32:53.439086 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.438965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.442134 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.441699    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.442134 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.441957    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8vwb\""
Jul 06 19:32:53.443102 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.442517    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-s4vht"]
Jul 06 19:32:53.443102 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.442820    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.443102 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.443057    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.443955 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.443397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.443955 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.443424    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bddq6\""
Jul 06 19:32:53.444924 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.444723    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:32:53.445012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.444926    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:32:53.445012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.444949    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4pfkh\""
Jul 06 19:32:53.446534 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.445371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.446534 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.446344    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.446534 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.446455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tgjz7\""
Jul 06 19:32:53.446719 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.446656    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.448732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.447264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:32:53.448732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.447426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.448732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.447549    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:32:53.448732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.447603    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:32:53.448732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.448160    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:32:53.449351 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.449333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:32:53.450149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.450129    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:32:53.450612 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.450329    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fc4bl\""
Jul 06 19:32:53.450612 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.450464    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sfff\" (UniqueName: \"kubernetes.io/projected/c8b59039-50e2-4592-b0b3-a6decb5f0f50-kube-api-access-4sfff\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-etc-kubernetes\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-cni-binary-copy\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-multus-certs\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-modprobe-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-tuned\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zfd\" (UniqueName: \"kubernetes.io/projected/fa73063b-9da4-4eef-a62d-b1ecc9792854-kube-api-access-t9zfd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-kubelet\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-var-lib-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-node-log\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-hostroot\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.520745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxfs\" (UniqueName: \"kubernetes.io/projected/b8461668-f6be-4f40-a905-72962797ced2-kube-api-access-ppxfs\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-log-socket\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-bin\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8532c2b0-ae47-453d-9d0c-fe9c4512890d-konnectivity-ca\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-bin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vb5n\" (UniqueName: \"kubernetes.io/projected/feebcf7c-7077-401d-b637-9799d1e73941-kube-api-access-7vb5n\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-sys-fs\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-lib-modules\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-script-lib\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5lj\" (UniqueName: \"kubernetes.io/projected/5edba12d-402f-48db-afce-d9deb4494fe1-kube-api-access-7s5lj\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.520977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-slash\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-etc-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-cnibin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-netns\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.521619 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-os-release\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5edba12d-402f-48db-afce-d9deb4494fe1-iptables-alerter-script\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-kubelet-config\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-dbus\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-tmp\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-systemd-units\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovn-node-metrics-cert\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-k8s-cni-cncf-io\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-conf-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjnp\" (UniqueName: \"kubernetes.io/projected/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kube-api-access-mfjnp\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-config\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f3e19b-bc18-49be-a80c-0d8b141bc79b-serviceca\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521427    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8532c2b0-ae47-453d-9d0c-fe9c4512890d-konnectivity-ca\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5fr\" (UniqueName: \"kubernetes.io/projected/66f3e19b-bc18-49be-a80c-0d8b141bc79b-kube-api-access-7t5fr\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8532c2b0-ae47-453d-9d0c-fe9c4512890d-agent-certs\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5edba12d-402f-48db-afce-d9deb4494fe1-host-slash\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.522314 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-sys\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-system-cni-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-env-overrides\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-systemd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8461668-f6be-4f40-a905-72962797ced2-hosts-file\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8461668-f6be-4f40-a905-72962797ced2-tmp-dir\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-netd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-system-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-device-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-systemd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-netns\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-os-release\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f3e19b-bc18-49be-a80c-0d8b141bc79b-host\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysconfig\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521964    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.521970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-host\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cnibin\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg25r\" (UniqueName: \"kubernetes.io/projected/4535998b-6316-4c63-a2b5-8b6cd7cf9622-kube-api-access-tg25r\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-socket-dir-parent\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-multus\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-kubelet\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-socket-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-run\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-ovn\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-kubernetes\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-conf\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tdt6\" (UniqueName: \"kubernetes.io/projected/2bae0a5a-2536-48e9-a413-02dfcfd0488c-kube-api-access-7tdt6\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:53.523847 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-multus-daemon-config\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.524580 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.524580 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-registration-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.524580 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.522527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-var-lib-kubelet\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.527877 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.527853    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8532c2b0-ae47-453d-9d0c-fe9c4512890d-agent-certs\") pod \"konnectivity-agent-kcb9m\" (UID: \"8532c2b0-ae47-453d-9d0c-fe9c4512890d\") " pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.623243 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-hostroot\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.623243 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxfs\" (UniqueName: \"kubernetes.io/projected/b8461668-f6be-4f40-a905-72962797ced2-kube-api-access-ppxfs\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-log-socket\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623304    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-hostroot\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-bin\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623379    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623410    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-bin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623458    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-bin\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vb5n\" (UniqueName: \"kubernetes.io/projected/feebcf7c-7077-401d-b637-9799d1e73941-kube-api-access-7vb5n\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-sys-fs\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623510    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-bin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-lib-modules\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-script-lib\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-sys-fs\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5lj\" (UniqueName: \"kubernetes.io/projected/5edba12d-402f-48db-afce-d9deb4494fe1-kube-api-access-7s5lj\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.624083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623670    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-lib-modules\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623673    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-log-socket\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-slash\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-etc-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-slash\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-cnibin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.623841    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-netns\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623851    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-cnibin\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623907    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-etc-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-run-netns\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.623944    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.123903248 +0000 UTC m=+2.911366288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-os-release\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.623992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5edba12d-402f-48db-afce-d9deb4494fe1-iptables-alerter-script\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624120    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-os-release\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.624989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624192    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-kubelet-config\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624304    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-script-lib\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-kubelet-config\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-dbus\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-tmp\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624591    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5edba12d-402f-48db-afce-d9deb4494fe1-iptables-alerter-script\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-systemd-units\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624632    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-systemd-units\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovn-node-metrics-cert\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624681    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-k8s-cni-cncf-io\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/39b49259-1e4e-474f-ab87-5b028f8b71ef-dbus\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624706    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-conf-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjnp\" (UniqueName: \"kubernetes.io/projected/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kube-api-access-mfjnp\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-config\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f3e19b-bc18-49be-a80c-0d8b141bc79b-serviceca\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5fr\" (UniqueName: \"kubernetes.io/projected/66f3e19b-bc18-49be-a80c-0d8b141bc79b-kube-api-access-7t5fr\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5edba12d-402f-48db-afce-d9deb4494fe1-host-slash\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.625849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-sys\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-system-cni-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-env-overrides\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-systemd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.624993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8461668-f6be-4f40-a905-72962797ced2-hosts-file\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8461668-f6be-4f40-a905-72962797ced2-tmp-dir\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-netd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-system-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-device-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-systemd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625146    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-sys\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-netns\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-systemd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-os-release\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.626743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625222    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-netns\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625230    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-system-cni-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f3e19b-bc18-49be-a80c-0d8b141bc79b-host\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625281    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8461668-f6be-4f40-a905-72962797ced2-hosts-file\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysconfig\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-host\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cnibin\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg25r\" (UniqueName: \"kubernetes.io/projected/4535998b-6316-4c63-a2b5-8b6cd7cf9622-kube-api-access-tg25r\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-socket-dir-parent\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-multus\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-kubelet\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-socket-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-run\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-ovn\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-kubernetes\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.627572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625587    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8461668-f6be-4f40-a905-72962797ced2-tmp-dir\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-conf\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tdt6\" (UniqueName: \"kubernetes.io/projected/2bae0a5a-2536-48e9-a413-02dfcfd0488c-kube-api-access-7tdt6\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625643    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-env-overrides\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-multus-daemon-config\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.625740    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625763    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.625789    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.125773676 +0000 UTC m=+2.913236701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-registration-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625827    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-cni-netd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625890    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-system-cni-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625896    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625740    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-registration-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-device-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.628411 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-var-lib-kubelet\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sfff\" (UniqueName: \"kubernetes.io/projected/c8b59039-50e2-4592-b0b3-a6decb5f0f50-kube-api-access-4sfff\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-etc-kubernetes\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626095    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-socket-dir-parent\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-cni-binary-copy\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-multus-certs\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-modprobe-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-tuned\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626305    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zfd\" (UniqueName: \"kubernetes.io/projected/fa73063b-9da4-4eef-a62d-b1ecc9792854-kube-api-access-t9zfd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-kubelet\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-var-lib-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-node-log\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626531    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-node-log\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.629447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626577    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-host-kubelet\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-var-lib-openvswitch\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626621    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626728    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-var-lib-kubelet\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-os-release\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626791    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-etc-kubernetes\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626852    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-multus-conf-dir\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-kubelet\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626912    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-run\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626927    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-var-lib-cni-multus\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.626955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-ovn\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627000    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-kubernetes\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627018    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-socket-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627067    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysconfig\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627105    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-sysctl-conf\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627455    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovnkube-config\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5edba12d-402f-48db-afce-d9deb4494fe1-host-slash\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.630300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627582    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f3e19b-bc18-49be-a80c-0d8b141bc79b-host\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.625318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-k8s-cni-cncf-io\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-host\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627696    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f3e19b-bc18-49be-a80c-0d8b141bc79b-serviceca\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627732    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feebcf7c-7077-401d-b637-9799d1e73941-host-run-multus-certs\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627769    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bae0a5a-2536-48e9-a413-02dfcfd0488c-cnibin\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627787    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-modprobe-d\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627874    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4535998b-6316-4c63-a2b5-8b6cd7cf9622-run-systemd\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-multus-daemon-config\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.627979    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bae0a5a-2536-48e9-a413-02dfcfd0488c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.629056    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feebcf7c-7077-401d-b637-9799d1e73941-cni-binary-copy\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.629148    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-tmp\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.631179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.631045    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa73063b-9da4-4eef-a62d-b1ecc9792854-etc-tuned\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.633012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.632982    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4535998b-6316-4c63-a2b5-8b6cd7cf9622-ovn-node-metrics-cert\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.638566 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.638262    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:53.638566 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.638284    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:53.638566 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.638298    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:53.638566 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:53.638369    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:32:54.138350675 +0000 UTC m=+2.925813717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:53.639381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.639027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vb5n\" (UniqueName: \"kubernetes.io/projected/feebcf7c-7077-401d-b637-9799d1e73941-kube-api-access-7vb5n\") pod \"multus-ffk8d\" (UID: \"feebcf7c-7077-401d-b637-9799d1e73941\") " pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.640796 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.640750    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjnp\" (UniqueName: \"kubernetes.io/projected/a90ffcb3-7783-4291-8e69-c4bd8bc65db5-kube-api-access-mfjnp\") pod \"aws-ebs-csi-driver-node-lf7cv\" (UID: \"a90ffcb3-7783-4291-8e69-c4bd8bc65db5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.642068 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.641919    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5lj\" (UniqueName: \"kubernetes.io/projected/5edba12d-402f-48db-afce-d9deb4494fe1-kube-api-access-7s5lj\") pod \"iptables-alerter-j5xc7\" (UID: \"5edba12d-402f-48db-afce-d9deb4494fe1\") " pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.642571 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.642549    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zfd\" (UniqueName: \"kubernetes.io/projected/fa73063b-9da4-4eef-a62d-b1ecc9792854-kube-api-access-t9zfd\") pod \"tuned-phwsv\" (UID: \"fa73063b-9da4-4eef-a62d-b1ecc9792854\") " pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.643257 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.643229    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tdt6\" (UniqueName: \"kubernetes.io/projected/2bae0a5a-2536-48e9-a413-02dfcfd0488c-kube-api-access-7tdt6\") pod \"multus-additional-cni-plugins-nnk76\" (UID: \"2bae0a5a-2536-48e9-a413-02dfcfd0488c\") " pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.644301 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.644255    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxfs\" (UniqueName: \"kubernetes.io/projected/b8461668-f6be-4f40-a905-72962797ced2-kube-api-access-ppxfs\") pod \"node-resolver-6rfnr\" (UID: \"b8461668-f6be-4f40-a905-72962797ced2\") " pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.644301 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.644273    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5fr\" (UniqueName: \"kubernetes.io/projected/66f3e19b-bc18-49be-a80c-0d8b141bc79b-kube-api-access-7t5fr\") pod \"node-ca-s4vht\" (UID: \"66f3e19b-bc18-49be-a80c-0d8b141bc79b\") " pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.645589 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.645568    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg25r\" (UniqueName: \"kubernetes.io/projected/4535998b-6316-4c63-a2b5-8b6cd7cf9622-kube-api-access-tg25r\") pod \"ovnkube-node-4j8cn\" (UID: \"4535998b-6316-4c63-a2b5-8b6cd7cf9622\") " pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.645697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.645633    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sfff\" (UniqueName: \"kubernetes.io/projected/c8b59039-50e2-4592-b0b3-a6decb5f0f50-kube-api-access-4sfff\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:53.731445 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.731407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:32:53.742683 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.742656    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j5xc7"
Jul 06 19:32:53.759241 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.759203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ffk8d"
Jul 06 19:32:53.764987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.764969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv"
Jul 06 19:32:53.771520 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.771495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-phwsv"
Jul 06 19:32:53.779154 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.779136    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rfnr"
Jul 06 19:32:53.785889 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.785867    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnk76"
Jul 06 19:32:53.793768 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.793748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:32:53.800447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.800416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s4vht"
Jul 06 19:32:53.837737 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.837667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal" event={"ID":"97735e9d98280d40d4e83cd0f2003464","Type":"ContainerStarted","Data":"a01eb95e6c26d7638468b96bb17cbc46ad9bcb86824ac66ad92b199eb3ac1405"}
Jul 06 19:32:53.838786 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:53.838752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal" event={"ID":"900304adc0a22b16c5b55433db5b23be","Type":"ContainerStarted","Data":"a443cf0f9cdf3d85fce819372629f8e2716ccde888ab47dfd20d1aa46f024cf3"}
Jul 06 19:32:54.046633 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.046536    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:53 +0000 UTC" deadline="2027-12-07 15:12:00.943975354 +0000 UTC"
Jul 06 19:32:54.046633 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.046587    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12451h39m6.897392359s"
Jul 06 19:32:54.130328 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.130293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:54.130328 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.130337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:54.130534 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.130436    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:54.130534 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.130439    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:54.130534 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.130507    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:32:55.130492447 +0000 UTC m=+3.917955471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:54.130534 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.130523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:55.13051581 +0000 UTC m=+3.917978830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:54.231079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.231034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:54.231224 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.231209    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:54.231284 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.231232    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:54.231284 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.231245    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:54.231376 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.231314    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:32:55.23129438 +0000 UTC m=+4.018757409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:54.723014 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.722982    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bae0a5a_2536_48e9_a413_02dfcfd0488c.slice/crio-34e3e270eeff4af3d631ec66154c7cce5905cfeaa9ed6bed4e412d51369fdc5f WatchSource:0}: Error finding container 34e3e270eeff4af3d631ec66154c7cce5905cfeaa9ed6bed4e412d51369fdc5f: Status 404 returned error can't find the container with id 34e3e270eeff4af3d631ec66154c7cce5905cfeaa9ed6bed4e412d51369fdc5f
Jul 06 19:32:54.724506 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.724459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edba12d_402f_48db_afce_d9deb4494fe1.slice/crio-e0af3ba0ac3028bfa279bd1a0c23ec2732ab7d7f0528d81ad8f8716e482679f7 WatchSource:0}: Error finding container e0af3ba0ac3028bfa279bd1a0c23ec2732ab7d7f0528d81ad8f8716e482679f7: Status 404 returned error can't find the container with id e0af3ba0ac3028bfa279bd1a0c23ec2732ab7d7f0528d81ad8f8716e482679f7
Jul 06 19:32:54.727870 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.727846    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeebcf7c_7077_401d_b637_9799d1e73941.slice/crio-b8967a00274f4c615d97362949fe50f1d3afb5b8553653ede3767fa6cd75ad87 WatchSource:0}: Error finding container b8967a00274f4c615d97362949fe50f1d3afb5b8553653ede3767fa6cd75ad87: Status 404 returned error can't find the container with id b8967a00274f4c615d97362949fe50f1d3afb5b8553653ede3767fa6cd75ad87
Jul 06 19:32:54.728510 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.728469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8461668_f6be_4f40_a905_72962797ced2.slice/crio-7c7bacac3b520881eaac54227f6e1d0298ddc34a4b3bc0b1aa126bf9d6436550 WatchSource:0}: Error finding container 7c7bacac3b520881eaac54227f6e1d0298ddc34a4b3bc0b1aa126bf9d6436550: Status 404 returned error can't find the container with id 7c7bacac3b520881eaac54227f6e1d0298ddc34a4b3bc0b1aa126bf9d6436550
Jul 06 19:32:54.729355 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.729315    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90ffcb3_7783_4291_8e69_c4bd8bc65db5.slice/crio-644d4d7cc66e8d7e87f6f7abbb7dff23ca812bfd9163a782fdb1cc2eb8f2ca95 WatchSource:0}: Error finding container 644d4d7cc66e8d7e87f6f7abbb7dff23ca812bfd9163a782fdb1cc2eb8f2ca95: Status 404 returned error can't find the container with id 644d4d7cc66e8d7e87f6f7abbb7dff23ca812bfd9163a782fdb1cc2eb8f2ca95
Jul 06 19:32:54.730705 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.730568    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4535998b_6316_4c63_a2b5_8b6cd7cf9622.slice/crio-f45bfd5e00f70fd6b1f89117891e15bf333d40eb8e97db2391da152d7b91b22c WatchSource:0}: Error finding container f45bfd5e00f70fd6b1f89117891e15bf333d40eb8e97db2391da152d7b91b22c: Status 404 returned error can't find the container with id f45bfd5e00f70fd6b1f89117891e15bf333d40eb8e97db2391da152d7b91b22c
Jul 06 19:32:54.733542 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:32:54.733522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f3e19b_bc18_49be_a80c_0d8b141bc79b.slice/crio-fc6f745c03be45a6e95402a17a12775a28390f561b9857e9520f7d9e7b7e9691 WatchSource:0}: Error finding container fc6f745c03be45a6e95402a17a12775a28390f561b9857e9520f7d9e7b7e9691: Status 404 returned error can't find the container with id fc6f745c03be45a6e95402a17a12775a28390f561b9857e9520f7d9e7b7e9691
Jul 06 19:32:54.832957 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.832796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:54.833104 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.832859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:54.833104 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.833030    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:32:54.833208 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:54.833121    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:32:54.844254 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.844219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"f45bfd5e00f70fd6b1f89117891e15bf333d40eb8e97db2391da152d7b91b22c"}
Jul 06 19:32:54.845785 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.845762    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rfnr" event={"ID":"b8461668-f6be-4f40-a905-72962797ced2","Type":"ContainerStarted","Data":"7c7bacac3b520881eaac54227f6e1d0298ddc34a4b3bc0b1aa126bf9d6436550"}
Jul 06 19:32:54.850189 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.850134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ffk8d" event={"ID":"feebcf7c-7077-401d-b637-9799d1e73941","Type":"ContainerStarted","Data":"b8967a00274f4c615d97362949fe50f1d3afb5b8553653ede3767fa6cd75ad87"}
Jul 06 19:32:54.852041 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.852021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal" event={"ID":"900304adc0a22b16c5b55433db5b23be","Type":"ContainerStarted","Data":"63918b8d5f7ad827a48da1006f9f02eb2eec975035b37cc749881393338ae6c6"}
Jul 06 19:32:54.853110 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.853080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phwsv" event={"ID":"fa73063b-9da4-4eef-a62d-b1ecc9792854","Type":"ContainerStarted","Data":"cf1656da8346cf9d1c95ac7fe02f699e5fe1fdc16b0f8a2d5457ed7e004aa895"}
Jul 06 19:32:54.854048 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.854027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kcb9m" event={"ID":"8532c2b0-ae47-453d-9d0c-fe9c4512890d","Type":"ContainerStarted","Data":"fbd3618618f4a7250c8a4d2abc99721bac588e9a3e3171faf0eeb5cd2bc93174"}
Jul 06 19:32:54.856390 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.856370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4vht" event={"ID":"66f3e19b-bc18-49be-a80c-0d8b141bc79b","Type":"ContainerStarted","Data":"fc6f745c03be45a6e95402a17a12775a28390f561b9857e9520f7d9e7b7e9691"}
Jul 06 19:32:54.857988 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.857968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv" event={"ID":"a90ffcb3-7783-4291-8e69-c4bd8bc65db5","Type":"ContainerStarted","Data":"644d4d7cc66e8d7e87f6f7abbb7dff23ca812bfd9163a782fdb1cc2eb8f2ca95"}
Jul 06 19:32:54.860450 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.860430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5xc7" event={"ID":"5edba12d-402f-48db-afce-d9deb4494fe1","Type":"ContainerStarted","Data":"e0af3ba0ac3028bfa279bd1a0c23ec2732ab7d7f0528d81ad8f8716e482679f7"}
Jul 06 19:32:54.861455 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:54.861438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerStarted","Data":"34e3e270eeff4af3d631ec66154c7cce5905cfeaa9ed6bed4e412d51369fdc5f"}
Jul 06 19:32:55.047269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.047204    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:27:53 +0000 UTC" deadline="2028-01-09 02:28:40.441275948 +0000 UTC"
Jul 06 19:32:55.047269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.047257    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13230h55m45.394022009s"
Jul 06 19:32:55.138092 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.138059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:55.138268 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.138144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:55.138327 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.138268    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:55.138370 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.138329    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:32:57.138310954 +0000 UTC m=+5.925773974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:55.138774 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.138750    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:55.138901 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.138809    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:32:57.138793514 +0000 UTC m=+5.926256534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:55.238696 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.238580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:55.238859 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.238786    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:55.238859 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.238805    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:55.238859 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.238817    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:55.239019 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.238878    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:32:57.238860488 +0000 UTC m=+6.026323530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:55.526007 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.525743    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:32:55.833668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.833635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:55.834144 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:55.833789    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:32:55.897941 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.897901    2578 generic.go:356] "Generic (PLEG): container finished" podID="97735e9d98280d40d4e83cd0f2003464" containerID="9ad18f6b5c83d0f4631e2734311a8e056675eea01f92db5f483562984ce22f2a" exitCode=0
Jul 06 19:32:55.898903 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.898869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal" event={"ID":"97735e9d98280d40d4e83cd0f2003464","Type":"ContainerDied","Data":"9ad18f6b5c83d0f4631e2734311a8e056675eea01f92db5f483562984ce22f2a"}
Jul 06 19:32:55.917133 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:55.917035    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-8.ec2.internal" podStartSLOduration=3.9170143 podStartE2EDuration="3.9170143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:54.869903141 +0000 UTC m=+3.657366184" watchObservedRunningTime="2026-07-06 19:32:55.9170143 +0000 UTC m=+4.704477343"
Jul 06 19:32:56.833602 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:56.833566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:56.833786 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:56.833759    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:32:56.834155 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:56.834135    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:56.834358 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:56.834222    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:32:56.920756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:56.920717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal" event={"ID":"97735e9d98280d40d4e83cd0f2003464","Type":"ContainerStarted","Data":"c8fae9aa10a04ba507f85ae52d38683f9347d7f8d121e7cf2dfd0f3462cb749f"}
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:57.158273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:57.158349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.158490    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.158555    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:01.158537012 +0000 UTC m=+9.946000049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.158971    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:57.159106 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.159023    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:33:01.159008416 +0000 UTC m=+9.946471439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:32:57.260022 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:57.259421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:57.260022 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.259598    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:32:57.260022 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.259617    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:32:57.260022 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.259629    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:57.260022 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.259688    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:33:01.259669598 +0000 UTC m=+10.047132623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:32:57.832693 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:57.832661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:57.832855 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:57.832803    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:32:58.833095 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:58.833059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:32:58.833571 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:58.833193    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:32:58.833635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:58.833616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:32:58.833759 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:58.833711    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:32:59.833342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:32:59.833262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:32:59.833816 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:32:59.833415    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:00.833687 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:00.833266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:00.833687 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:00.833399    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:00.833687 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:00.833514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:00.833687 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:00.833629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:01.189953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:01.190007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.190148    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.190172    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.190208    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:09.190188967 +0000 UTC m=+17.977651990 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:01.190343 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.190237    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:33:09.190215824 +0000 UTC m=+17.977678850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:01.291327 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:01.291227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:01.291509 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.291365    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:33:01.291509 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.291387    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:33:01.291509 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.291398    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:01.291509 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.291457    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:33:09.291439681 +0000 UTC m=+18.078902718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:01.834329 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:01.834287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:01.834853 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:01.834423    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:02.833496 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:02.833401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:02.833649 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:02.833555    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:02.833999 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:02.833977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:02.834129 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:02.834079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:03.834370 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:03.834337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:03.834842 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:03.834496    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:04.832723 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:04.832685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:04.832891 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:04.832691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:04.832891 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:04.832819    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:04.832891 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:04.832877    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:05.833286 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:05.833247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:05.833737 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:05.833373    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:06.833552 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:06.833514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:06.834024 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:06.833534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:06.834024 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:06.833658    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:06.834024 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:06.833717    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:07.832786 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:07.832752    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:07.832972 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:07.832887    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:08.832635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:08.832591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:08.832635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:08.832627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:08.833205 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:08.832735    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:08.833205 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:08.832794    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:09.252400 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:09.252321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:09.252400 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:09.252364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:09.252650 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.252454    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:09.252650 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.252456    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:09.252650 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.252520    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.252506447 +0000 UTC m=+34.039969466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:09.252650 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.252535    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.252528452 +0000 UTC m=+34.039991471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:09.353667 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:09.353623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:09.353845 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.353781    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:33:09.353845 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.353805    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:33:09.353845 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.353816    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:09.354010 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.353890    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.353862555 +0000 UTC m=+34.141325576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:09.833287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:09.833255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:09.833740 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:09.833383    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:10.832810 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:10.832774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:10.832991 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:10.832902    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:10.832991 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:10.832956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:10.833093 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:10.833056    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:11.834232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:11.834190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:11.834683 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:11.834322    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:12.832916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:12.832884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:12.832916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:12.832913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:12.833159 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:12.832991    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:12.833212 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:12.833147    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:13.833296 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.833128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:13.833912 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:13.833382    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:13.958330 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.958304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-phwsv" event={"ID":"fa73063b-9da4-4eef-a62d-b1ecc9792854","Type":"ContainerStarted","Data":"36e1a40380353756587a7430bca28c3b33b1143a8953f705f484cd6d5bed6082"}
Jul 06 19:33:13.959749 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.959728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kcb9m" event={"ID":"8532c2b0-ae47-453d-9d0c-fe9c4512890d","Type":"ContainerStarted","Data":"2a73b8ab2f1f8f7af65d9abf977500a6732433957b660accf5cf137a78e8184c"}
Jul 06 19:33:13.961064 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.961039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s4vht" event={"ID":"66f3e19b-bc18-49be-a80c-0d8b141bc79b","Type":"ContainerStarted","Data":"88f2df387e087a76a1a98f8c20086ab0207934f31186c42b3eea70d8225730a1"}
Jul 06 19:33:13.962524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.962502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv" event={"ID":"a90ffcb3-7783-4291-8e69-c4bd8bc65db5","Type":"ContainerStarted","Data":"0f29709486d0636a10c9c1fcafbc8223257887e3af9091a0dc070f488d6c410e"}
Jul 06 19:33:13.963984 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.963961    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="cb6ec85ea45351da166899266945af52585aa16b64024e2461692ed22d90b203" exitCode=0
Jul 06 19:33:13.964057 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.964036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"cb6ec85ea45351da166899266945af52585aa16b64024e2461692ed22d90b203"}
Jul 06 19:33:13.966588 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.966564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"546e8081966f919839b103be16fdbb4bcb40b61903362f7694883d93ff0ad7c6"}
Jul 06 19:33:13.966663 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.966643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"dd2d7cba6aa950fc9445edf6eca44c0f7477a5cdfe1c352cbedec65335429ffe"}
Jul 06 19:33:13.966712 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.966695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"c092a70d006bc63ad932f28bf894ea54c783aacafad2201fd8779b2a394288ee"}
Jul 06 19:33:13.967937 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.967916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rfnr" event={"ID":"b8461668-f6be-4f40-a905-72962797ced2","Type":"ContainerStarted","Data":"68864d7e5c11eb9a02a35ad2ef643506672bd73d5790bcf2e8b3521434d8abbd"}
Jul 06 19:33:13.969201 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.969181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ffk8d" event={"ID":"feebcf7c-7077-401d-b637-9799d1e73941","Type":"ContainerStarted","Data":"04e7fc66c6035a40cbde4d45ad41fffdfca12cd63ee7e4dc4c2547752373454e"}
Jul 06 19:33:13.983850 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:13.983804    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-8.ec2.internal" podStartSLOduration=21.983791589 podStartE2EDuration="21.983791589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:56.95642147 +0000 UTC m=+5.743884513" watchObservedRunningTime="2026-07-06 19:33:13.983791589 +0000 UTC m=+22.771254631"
Jul 06 19:33:14.007183 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.004989    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ffk8d" podStartSLOduration=4.195372328 podStartE2EDuration="23.004971393s" totalImagesPullingTime="18.809599065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.004453149 +0000 UTC m=+22.791916195" watchObservedRunningTime="2026-07-06 19:33:14.004971393 +0000 UTC m=+22.792434445"
Jul 06 19:33:14.007183 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.005172    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-phwsv" podStartSLOduration=4.248745712 podStartE2EDuration="23.005155462s" totalImagesPullingTime="18.75640975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:13.983456955 +0000 UTC m=+22.770919996" watchObservedRunningTime="2026-07-06 19:33:14.005155462 +0000 UTC m=+22.792618504"
Jul 06 19:33:14.020104 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.020060    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6rfnr" podStartSLOduration=4.257252975 podStartE2EDuration="23.020048045s" totalImagesPullingTime="18.76279507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.019820239 +0000 UTC m=+22.807283282" watchObservedRunningTime="2026-07-06 19:33:14.020048045 +0000 UTC m=+22.807511087"
Jul 06 19:33:14.061711 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.061667    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s4vht" podStartSLOduration=3.306065334 podStartE2EDuration="22.061653472s" totalImagesPullingTime="18.755588138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.061410277 +0000 UTC m=+22.848873321" watchObservedRunningTime="2026-07-06 19:33:14.061653472 +0000 UTC m=+22.849116513"
Jul 06 19:33:14.076949 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.076910    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kcb9m" podStartSLOduration=12.619747319 podStartE2EDuration="23.076892483s" totalImagesPullingTime="10.457145164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.076725935 +0000 UTC m=+22.864188985" watchObservedRunningTime="2026-07-06 19:33:14.076892483 +0000 UTC m=+22.864355526"
Jul 06 19:33:14.833317 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.833235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:14.833317 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.833255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:14.833958 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:14.833349    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:14.833958 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:14.833429    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:14.973834 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.973796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j5xc7" event={"ID":"5edba12d-402f-48db-afce-d9deb4494fe1","Type":"ContainerStarted","Data":"c89eb71bfbf67a6b326dcdefb30dabda8fa5d84022d58ad8a93309f087e96f4d"}
Jul 06 19:33:14.978130 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.978100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"592f07279739a713222b58d42eff1da478e7254ef9d92e898fe04b8e4555c108"}
Jul 06 19:33:14.978266 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.978186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"172535d859e49977fb9001f35cb833b7f4d9e67a6d1502f884bf0db0a49a877d"}
Jul 06 19:33:14.978266 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:14.978234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"0143a3800d88ae752ae13c24153ed55eb7f1241d8162a5945d952ba138ebbb33"}
Jul 06 19:33:15.051202 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.051167    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:33:15.683030 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.682907    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:33:15.051197113Z","UUID":"1084a3f1-faaa-49e6-9b08-f6f959b95179","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:33:15.684797 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.684708    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:33:15.684797 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.684798    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:33:15.833402 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.833344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:15.834033 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:15.833561    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:15.876373 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.876341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:33:15.876998 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.876979    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:33:15.896864 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.896811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j5xc7" podStartSLOduration=6.130092856 podStartE2EDuration="24.896795173s" totalImagesPullingTime="18.766702317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:14.992576763 +0000 UTC m=+23.780039808" watchObservedRunningTime="2026-07-06 19:33:15.896795173 +0000 UTC m=+24.684258215"
Jul 06 19:33:15.982117 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.982073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv" event={"ID":"a90ffcb3-7783-4291-8e69-c4bd8bc65db5","Type":"ContainerStarted","Data":"8b4151dac2b021f2015b2a01ac6e06b5c47a8dd43349bd1a2f5d616d1e93f4f5"}
Jul 06 19:33:15.982435 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.982409    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:33:15.982884 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:15.982857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kcb9m"
Jul 06 19:33:16.832684 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:16.832650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:16.832877 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:16.832719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:16.832877 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:16.832860    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:16.833006 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:16.832987    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:16.988310 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:16.988264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"5a2959403f430d7220bec6f0443ac0f0a8a48a427345cb0db86ed0fbf07956a3"}
Jul 06 19:33:16.990925 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:16.990887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv" event={"ID":"a90ffcb3-7783-4291-8e69-c4bd8bc65db5","Type":"ContainerStarted","Data":"6c53eff060aed62b5881195e3faf197275cbdfb7083e54160e3c912442baf5b9"}
Jul 06 19:33:17.012381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:17.012327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lf7cv" podStartSLOduration=5.1302004629999995 podStartE2EDuration="26.012310543s" totalImagesPullingTime="20.88211008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:17.012195476 +0000 UTC m=+25.799658518" watchObservedRunningTime="2026-07-06 19:33:17.012310543 +0000 UTC m=+25.799773609"
Jul 06 19:33:17.833615 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:17.833399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:17.833804 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:17.833728    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:18.832988 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:18.832787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:18.833696 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:18.832834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:18.833696 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:18.833060    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:18.833696 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:18.833135    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:18.998464 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:18.998428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" event={"ID":"4535998b-6316-4c63-a2b5-8b6cd7cf9622","Type":"ContainerStarted","Data":"d0decc6c8e2cf4b07f8abdd59d223b794340d61e7d8aa74164213ec457f535b9"}
Jul 06 19:33:18.998700 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:18.998678    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:18.998768 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:18.998759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:19.000288 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:19.000265    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="550f31e0aa9d0219975ae6050a6ef908a362c017a3bfd2d2e660a3439071a681" exitCode=0
Jul 06 19:33:19.000382 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:19.000298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"550f31e0aa9d0219975ae6050a6ef908a362c017a3bfd2d2e660a3439071a681"}
Jul 06 19:33:19.015504 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:19.015460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:19.032971 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:19.032921    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn" podStartSLOduration=9.205748135 podStartE2EDuration="28.032908024s" totalImagesPullingTime="18.827159889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:19.032494902 +0000 UTC m=+27.819957939" watchObservedRunningTime="2026-07-06 19:33:19.032908024 +0000 UTC m=+27.820371066"
Jul 06 19:33:19.833181 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:19.833149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:19.833591 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:19.833272    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:20.002779 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.002745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:20.017793 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.017768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:20.486543 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.486448    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64mk7"]
Jul 06 19:33:20.486718 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.486616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:20.486718 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:20.486703    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:20.490997 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.490974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nr9l6"]
Jul 06 19:33:20.491141 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.491081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:20.491214 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:20.491191    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:20.491638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.491614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wckz5"]
Jul 06 19:33:20.491758 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:20.491714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:20.491822 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:20.491806    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:21.006846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:21.006810    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="fdd5016c2ac593ffeef2767ab275126cca89a18b299be9ac4391e88f4fe35770" exitCode=0
Jul 06 19:33:21.007342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:21.006901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"fdd5016c2ac593ffeef2767ab275126cca89a18b299be9ac4391e88f4fe35770"}
Jul 06 19:33:21.836927 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:21.836740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:21.837094 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:21.836741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:21.837094 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:21.836998    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:21.837094 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:21.837075    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:22.833159 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:22.833066    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:22.833716 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:22.833194    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:23.015343 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:23.015311    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="e89963e1ac5df9a5f6748c7e7287aa3fc6ae3a8afe191e0c07f5013c7d8fa9f9" exitCode=0
Jul 06 19:33:23.015499 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:23.015364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"e89963e1ac5df9a5f6748c7e7287aa3fc6ae3a8afe191e0c07f5013c7d8fa9f9"}
Jul 06 19:33:23.836624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:23.836593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:23.837229 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:23.836707    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:23.837229 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:23.836766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:23.837229 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:23.836868    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:24.833336 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:24.833299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:24.833535 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:24.833415    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:25.274612 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:25.274576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:25.275152 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:25.274657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:25.275152 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.274756    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:25.275152 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.274758    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:25.275152 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.274820    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret podName:39b49259-1e4e-474f-ab87-5b028f8b71ef nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.274801075 +0000 UTC m=+66.062264098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret") pod "global-pull-secret-syncer-64mk7" (UID: "39b49259-1e4e-474f-ab87-5b028f8b71ef") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:33:25.275152 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.274841    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.27483053 +0000 UTC m=+66.062293555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:33:25.375544 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:25.375507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:25.375708 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.375677    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:33:25.375708 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.375697    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:33:25.375708 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.375706    2578 projected.go:196] Error preparing data for projected volume kube-api-access-s5md2 for pod openshift-network-diagnostics/network-check-target-wckz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:25.375807 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.375760    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2 podName:7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb nodeName:}" failed. No retries permitted until 2026-07-06 19:33:57.375743778 +0000 UTC m=+66.163206798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s5md2" (UniqueName: "kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2") pod "network-check-target-wckz5" (UID: "7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:33:25.832762 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:25.832722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:25.832950 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:25.832786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:25.832950 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.832862    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nr9l6" podUID="c8b59039-50e2-4592-b0b3-a6decb5f0f50"
Jul 06 19:33:25.833039 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:25.832988    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wckz5" podUID="7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb"
Jul 06 19:33:26.833234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:26.833195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:26.833775 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:26.833333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64mk7" podUID="39b49259-1e4e-474f-ab87-5b028f8b71ef"
Jul 06 19:33:27.525465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.525432    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-8.ec2.internal" event="NodeReady"
Jul 06 19:33:27.525643 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.525582    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:33:27.575078 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.575043    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fqwkf"]
Jul 06 19:33:27.596603 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.596577    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gc5fz"]
Jul 06 19:33:27.596748 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.596698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.599993 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.599965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:33:27.599993 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.599982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:33:27.600163 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.599989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zq5lq\""
Jul 06 19:33:27.621140 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.620649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gc5fz"]
Jul 06 19:33:27.621140 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.620685    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqwkf"]
Jul 06 19:33:27.621140 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.620783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.623922 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.623900    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:33:27.624035 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.623925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:33:27.624035 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.623942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:33:27.624266 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.624245    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c64kp\""
Jul 06 19:33:27.695289 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048ed20c-cce5-4626-ac6a-6cb9533bca15-tmp-dir\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.695425 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwxn\" (UniqueName: \"kubernetes.io/projected/048ed20c-cce5-4626-ac6a-6cb9533bca15-kube-api-access-bwwxn\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.695425 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.695425 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048ed20c-cce5-4626-ac6a-6cb9533bca15-config-volume\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.695635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ac4c6f-507e-4a81-be9a-226217d18ebe-cert\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.695635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.695515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljlt\" (UniqueName: \"kubernetes.io/projected/91ac4c6f-507e-4a81-be9a-226217d18ebe-kube-api-access-nljlt\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.796563 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwxn\" (UniqueName: \"kubernetes.io/projected/048ed20c-cce5-4626-ac6a-6cb9533bca15-kube-api-access-bwwxn\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.796563 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.796724 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048ed20c-cce5-4626-ac6a-6cb9533bca15-config-volume\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.796724 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ac4c6f-507e-4a81-be9a-226217d18ebe-cert\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.796820 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:27.796720    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:27.796820 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:27.796801    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:28.296776661 +0000 UTC m=+37.084239683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:27.796927 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nljlt\" (UniqueName: \"kubernetes.io/projected/91ac4c6f-507e-4a81-be9a-226217d18ebe-kube-api-access-nljlt\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.796927 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.796894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048ed20c-cce5-4626-ac6a-6cb9533bca15-tmp-dir\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.797369 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.797206    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048ed20c-cce5-4626-ac6a-6cb9533bca15-config-volume\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.797439 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.797206    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048ed20c-cce5-4626-ac6a-6cb9533bca15-tmp-dir\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.801049 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.801020    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91ac4c6f-507e-4a81-be9a-226217d18ebe-cert\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.807021 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.807001    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwxn\" (UniqueName: \"kubernetes.io/projected/048ed20c-cce5-4626-ac6a-6cb9533bca15-kube-api-access-bwwxn\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:27.807293 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.807273    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljlt\" (UniqueName: \"kubernetes.io/projected/91ac4c6f-507e-4a81-be9a-226217d18ebe-kube-api-access-nljlt\") pod \"ingress-canary-gc5fz\" (UID: \"91ac4c6f-507e-4a81-be9a-226217d18ebe\") " pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:27.833234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.833213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:27.833424 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.833404    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:27.836790 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.836769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gp52\""
Jul 06 19:33:27.836790 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.836801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:33:27.836953 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.836811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:33:27.836953 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.836811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:33:27.836953 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.836931    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9cds\""
Jul 06 19:33:27.929111 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:27.929075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gc5fz"
Jul 06 19:33:28.032552 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.032522    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="6401ba0ebf7d9706f6c77a482dae52313907114ec684808cfade44d4e3b197a6" exitCode=0
Jul 06 19:33:28.032716 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.032582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"6401ba0ebf7d9706f6c77a482dae52313907114ec684808cfade44d4e3b197a6"}
Jul 06 19:33:28.062408 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.062381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gc5fz"]
Jul 06 19:33:28.066763 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:33:28.066729    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ac4c6f_507e_4a81_be9a_226217d18ebe.slice/crio-9807e4c51be6def9ea8f4e68c02e828d3bf259e7248e29e608f464dcd8eea6a2 WatchSource:0}: Error finding container 9807e4c51be6def9ea8f4e68c02e828d3bf259e7248e29e608f464dcd8eea6a2: Status 404 returned error can't find the container with id 9807e4c51be6def9ea8f4e68c02e828d3bf259e7248e29e608f464dcd8eea6a2
Jul 06 19:33:28.301063 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.300975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:28.301207 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:28.301141    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:28.301246 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:28.301210    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:29.301193238 +0000 UTC m=+38.088656258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:28.832842 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.832808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:28.836034 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:28.836013    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:33:29.039639 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:29.039606    2578 generic.go:356] "Generic (PLEG): container finished" podID="2bae0a5a-2536-48e9-a413-02dfcfd0488c" containerID="67399d66d6fa50c6eaba5e06c1f59f0e4ec52d3cd2da803fd5f592a511741bb3" exitCode=0
Jul 06 19:33:29.039801 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:29.039696    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerDied","Data":"67399d66d6fa50c6eaba5e06c1f59f0e4ec52d3cd2da803fd5f592a511741bb3"}
Jul 06 19:33:29.041487 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:29.041439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gc5fz" event={"ID":"91ac4c6f-507e-4a81-be9a-226217d18ebe","Type":"ContainerStarted","Data":"9807e4c51be6def9ea8f4e68c02e828d3bf259e7248e29e608f464dcd8eea6a2"}
Jul 06 19:33:29.310835 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:29.310619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:29.311043 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:29.310653    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:29.311043 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:29.310994    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:31.310967431 +0000 UTC m=+40.098430457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:30.048512 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:30.048462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnk76" event={"ID":"2bae0a5a-2536-48e9-a413-02dfcfd0488c","Type":"ContainerStarted","Data":"c7f72af13e788538d5f97bcbc0178ded84ad305e152e0a96d7325ece49110025"}
Jul 06 19:33:30.075376 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:30.075315    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nnk76" podStartSLOduration=9.090293404 podStartE2EDuration="39.075293773s" totalImagesPullingTime="29.985000369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:30.073120864 +0000 UTC m=+38.860583903" watchObservedRunningTime="2026-07-06 19:33:30.075293773 +0000 UTC m=+38.862756813"
Jul 06 19:33:31.052581 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:31.052536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gc5fz" event={"ID":"91ac4c6f-507e-4a81-be9a-226217d18ebe","Type":"ContainerStarted","Data":"a0b148d2a10576d9ea683c3b13f5a1158659fa21f4388cd8725464c75f96124f"}
Jul 06 19:33:31.072419 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:31.072368    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gc5fz" podStartSLOduration=2.061458995 podStartE2EDuration="4.072353778s" totalImagesPullingTime="2.010894783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:31.07210445 +0000 UTC m=+39.859567505" watchObservedRunningTime="2026-07-06 19:33:31.072353778 +0000 UTC m=+39.859816819"
Jul 06 19:33:31.325792 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:31.325693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:31.325969 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:31.325871    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:31.325969 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:31.325947    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:35.32592624 +0000 UTC m=+44.113389263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:35.353405 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:35.353362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:35.353808 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:35.353536    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:35.353808 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:35.353604    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:43.353587271 +0000 UTC m=+52.141050291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:43.407584 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:43.407540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:43.408166 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:43.407724    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:43.408166 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:43.407811    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:59.407788873 +0000 UTC m=+68.195251906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:33:52.019908 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:52.019881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4j8cn"
Jul 06 19:33:57.306001 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.305961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:33:57.306459 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.306099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:57.309039 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.309010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:33:57.309145 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.309087    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:33:57.316407 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:57.316386    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:33:57.316462 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:57.316454    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs podName:c8b59039-50e2-4592-b0b3-a6decb5f0f50 nodeName:}" failed. No retries permitted until 2026-07-06 19:35:01.316438932 +0000 UTC m=+130.103901955 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs") pod "network-metrics-daemon-nr9l6" (UID: "c8b59039-50e2-4592-b0b3-a6decb5f0f50") : secret "metrics-daemon-secret" not found
Jul 06 19:33:57.319459 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.319438    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/39b49259-1e4e-474f-ab87-5b028f8b71ef-original-pull-secret\") pod \"global-pull-secret-syncer-64mk7\" (UID: \"39b49259-1e4e-474f-ab87-5b028f8b71ef\") " pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:57.343549 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.343516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64mk7"
Jul 06 19:33:57.407504 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.407365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:57.410731 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.410714    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:33:57.421455 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.421433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:33:57.431684 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.431655    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5md2\" (UniqueName: \"kubernetes.io/projected/7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb-kube-api-access-s5md2\") pod \"network-check-target-wckz5\" (UID: \"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb\") " pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:57.466489 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.466443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64mk7"]
Jul 06 19:33:57.469753 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:33:57.469728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b49259_1e4e_474f_ab87_5b028f8b71ef.slice/crio-9b43e05c6ce232271dc818cb45249711d04cac3524ea62a091541a9240961930 WatchSource:0}: Error finding container 9b43e05c6ce232271dc818cb45249711d04cac3524ea62a091541a9240961930: Status 404 returned error can't find the container with id 9b43e05c6ce232271dc818cb45249711d04cac3524ea62a091541a9240961930
Jul 06 19:33:57.577833 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.577751    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4gp52\""
Jul 06 19:33:57.585290 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.585265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:33:57.704767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:57.704735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wckz5"]
Jul 06 19:33:57.707824 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:33:57.707799    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1ae6dd_080b_44b7_ac9b_cfdf641f88cb.slice/crio-0b476029fba707a0a158e7d8b1613e5d442fdd8136729f370d4604d1477fd5a2 WatchSource:0}: Error finding container 0b476029fba707a0a158e7d8b1613e5d442fdd8136729f370d4604d1477fd5a2: Status 404 returned error can't find the container with id 0b476029fba707a0a158e7d8b1613e5d442fdd8136729f370d4604d1477fd5a2
Jul 06 19:33:58.121310 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:58.121273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wckz5" event={"ID":"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb","Type":"ContainerStarted","Data":"0b476029fba707a0a158e7d8b1613e5d442fdd8136729f370d4604d1477fd5a2"}
Jul 06 19:33:58.122613 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:58.122587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64mk7" event={"ID":"39b49259-1e4e-474f-ab87-5b028f8b71ef","Type":"ContainerStarted","Data":"9b43e05c6ce232271dc818cb45249711d04cac3524ea62a091541a9240961930"}
Jul 06 19:33:59.419889 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:33:59.419822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:33:59.420446 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:59.420000    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:33:59.420446 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:33:59.420081    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls podName:048ed20c-cce5-4626-ac6a-6cb9533bca15 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:31.420060803 +0000 UTC m=+100.207523825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls") pod "dns-default-fqwkf" (UID: "048ed20c-cce5-4626-ac6a-6cb9533bca15") : secret "dns-default-metrics-tls" not found
Jul 06 19:34:03.135923 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:03.135883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wckz5" event={"ID":"7a1ae6dd-080b-44b7-ac9b-cfdf641f88cb","Type":"ContainerStarted","Data":"aeb00337abe8acc5ac733639b9605b6c0070f25105b0039c7b478f1f72d2c5b6"}
Jul 06 19:34:03.136392 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:03.135975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:34:03.137316 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:03.137293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64mk7" event={"ID":"39b49259-1e4e-474f-ab87-5b028f8b71ef","Type":"ContainerStarted","Data":"e065f0798703f07b40283439623af65c3c593f67244061d76f9aa6823a063559"}
Jul 06 19:34:03.157886 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:03.157832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wckz5" podStartSLOduration=67.525499128 podStartE2EDuration="1m12.157818597s" totalImagesPullingTime="4.632319469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:03.157434107 +0000 UTC m=+71.944897149" watchObservedRunningTime="2026-07-06 19:34:03.157818597 +0000 UTC m=+71.945281638"
Jul 06 19:34:03.180124 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:03.180077    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-64mk7" podStartSLOduration=66.298455811 podStartE2EDuration="1m11.180064769s" totalImagesPullingTime="4.881608958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:03.179196236 +0000 UTC m=+71.966659283" watchObservedRunningTime="2026-07-06 19:34:03.180064769 +0000 UTC m=+71.967527812"
Jul 06 19:34:14.456840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.456699    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"]
Jul 06 19:34:14.459348 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.459325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"
Jul 06 19:34:14.462219 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.462200    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 19:34:14.462308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.462200    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:14.463506 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.463470    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zlqxq\""
Jul 06 19:34:14.467713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.467689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"]
Jul 06 19:34:14.528716 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.528679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwftw\" (UniqueName: \"kubernetes.io/projected/7e168e64-735b-41fe-a639-22afd0798ac1-kube-api-access-bwftw\") pod \"volume-data-source-validator-5d456fdbcd-kx6sm\" (UID: \"7e168e64-735b-41fe-a639-22afd0798ac1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"
Jul 06 19:34:14.561160 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.561132    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dwmmp"]
Jul 06 19:34:14.562902 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.562886    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.565571 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.565541    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 19:34:14.565752 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.565598    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 19:34:14.565752 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.565599    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:34:14.565752 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.565634    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:34:14.566185 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.566172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l85jv\""
Jul 06 19:34:14.574604 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.574464    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 19:34:14.575571 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.575551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dwmmp"]
Jul 06 19:34:14.629555 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.629711 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-tmp\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.629711 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-serving-cert\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.629711 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-snapshots\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.629815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwftw\" (UniqueName: \"kubernetes.io/projected/7e168e64-735b-41fe-a639-22afd0798ac1-kube-api-access-bwftw\") pod \"volume-data-source-validator-5d456fdbcd-kx6sm\" (UID: \"7e168e64-735b-41fe-a639-22afd0798ac1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"
Jul 06 19:34:14.629815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.629815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.629780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qft8\" (UniqueName: \"kubernetes.io/projected/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-kube-api-access-7qft8\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.638734 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.638699    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwftw\" (UniqueName: \"kubernetes.io/projected/7e168e64-735b-41fe-a639-22afd0798ac1-kube-api-access-bwftw\") pod \"volume-data-source-validator-5d456fdbcd-kx6sm\" (UID: \"7e168e64-735b-41fe-a639-22afd0798ac1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"
Jul 06 19:34:14.659238 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.659211    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"]
Jul 06 19:34:14.660971 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.660957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.663197 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.663165    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"]
Jul 06 19:34:14.663991 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.663967    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 19:34:14.664104 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.664040    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bcl4w\""
Jul 06 19:34:14.664104 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.664075    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 19:34:14.664810 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.664792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.667283 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.667261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 19:34:14.667363 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.667299    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 19:34:14.667703 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.667686    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:14.667750 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.667704    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-68hpj\""
Jul 06 19:34:14.667953 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.667936    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 19:34:14.680769 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.680749    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"]
Jul 06 19:34:14.694562 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.694535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"]
Jul 06 19:34:14.731171 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-snapshots\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731171 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld544\" (UniqueName: \"kubernetes.io/projected/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-kube-api-access-ld544\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.731171 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.731447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.731447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qft8\" (UniqueName: \"kubernetes.io/projected/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-kube-api-access-7qft8\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731447 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55159b70-deb2-4ad4-ad61-f343a24ac3f2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.731746 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-tmp\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731746 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-serving-cert\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731746 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.731887 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-snapshots\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731887 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731801    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-tmp\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.731949 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.731916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.732311 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.732288    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.733852 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.733832    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-serving-cert\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.740004 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.739986    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qft8\" (UniqueName: \"kubernetes.io/projected/f61458c5-d7c0-4c4f-bad2-413b1b47f6eb-kube-api-access-7qft8\") pod \"insights-operator-5c847dcfc4-dwmmp\" (UID: \"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb\") " pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.762915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.762886    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"]
Jul 06 19:34:14.765425 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.765410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.767570 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.767545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"
Jul 06 19:34:14.768009 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.767989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:34:14.768100 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.768029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:34:14.768166 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.768122    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:14.768166 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.768127    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:34:14.768166 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.768152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4fvvq\""
Jul 06 19:34:14.772117 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.772097    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:34:14.773941 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.773924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.775639 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.775610    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"]
Jul 06 19:34:14.776746 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.776727    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:34:14.776901 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.776882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:34:14.777138 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.777124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:34:14.777446 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.777433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rqjk7\""
Jul 06 19:34:14.784554 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.784525    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:34:14.790377 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.790285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:34:14.832498 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gfp8\" (UniqueName: \"kubernetes.io/projected/41b11697-a9ae-4066-babd-7d3781699ced-kube-api-access-4gfp8\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.832498 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832498 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832498 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832498 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41b11697-a9ae-4066-babd-7d3781699ced-config\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwzw\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41b11697-a9ae-4066-babd-7d3781699ced-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld544\" (UniqueName: \"kubernetes.io/projected/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-kube-api-access-ld544\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.832840 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.833296 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.832886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55159b70-deb2-4ad4-ad61-f343a24ac3f2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.833709 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.833681    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.833709 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:14.833699    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:14.833888 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:14.833783    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.333764092 +0000 UTC m=+84.121227113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:14.833973 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.833951    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55159b70-deb2-4ad4-ad61-f343a24ac3f2-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:14.836468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.836443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.843740 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.843719    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld544\" (UniqueName: \"kubernetes.io/projected/cdbfa8ac-3a23-41d4-af49-77ce2462afa3-kube-api-access-ld544\") pod \"kube-storage-version-migrator-operator-846bf668f7-4mnct\" (UID: \"cdbfa8ac-3a23-41d4-af49-77ce2462afa3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:14.873737 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.873710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp"
Jul 06 19:34:14.893136 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.893107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm"]
Jul 06 19:34:14.896336 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:14.896308    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e168e64_735b_41fe_a639_22afd0798ac1.slice/crio-d4a4b395342fd4b0f9302b22a5a4cb142ff46beb6b191a2b3204ec1f77b0141e WatchSource:0}: Error finding container d4a4b395342fd4b0f9302b22a5a4cb142ff46beb6b191a2b3204ec1f77b0141e: Status 404 returned error can't find the container with id d4a4b395342fd4b0f9302b22a5a4cb142ff46beb6b191a2b3204ec1f77b0141e
Jul 06 19:34:14.934210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwzw\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41b11697-a9ae-4066-babd-7d3781699ced-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.934340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934543 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934615 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934750 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gfp8\" (UniqueName: \"kubernetes.io/projected/41b11697-a9ae-4066-babd-7d3781699ced-kube-api-access-4gfp8\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.934750 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934931 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934931 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.934931 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.934842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41b11697-a9ae-4066-babd-7d3781699ced-config\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.935143 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.935007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.935143 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.935020    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.935143 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:14.935047    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:34:14.935143 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:14.935066    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc5d5869b-24bnv: secret "image-registry-tls" not found
Jul 06 19:34:14.935143 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:14.935145    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls podName:5ed41fa2-5d42-4ea1-9317-81ae348f521f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:15.435120897 +0000 UTC m=+84.222583917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls") pod "image-registry-fc5d5869b-24bnv" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f") : secret "image-registry-tls" not found
Jul 06 19:34:14.935702 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.935677    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41b11697-a9ae-4066-babd-7d3781699ced-config\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.935962 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.935943    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.936767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.936742    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41b11697-a9ae-4066-babd-7d3781699ced-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.937360 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.937336    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.937579 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.937562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.946285 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.946255    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwzw\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.946387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.946291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gfp8\" (UniqueName: \"kubernetes.io/projected/41b11697-a9ae-4066-babd-7d3781699ced-kube-api-access-4gfp8\") pod \"service-ca-operator-5d46d9ffd4-98pnc\" (UID: \"41b11697-a9ae-4066-babd-7d3781699ced\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:14.946426 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.946407    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:14.975933 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:14.975898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"
Jul 06 19:34:15.001744 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.001719    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-dwmmp"]
Jul 06 19:34:15.003864 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:15.003829    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61458c5_d7c0_4c4f_bad2_413b1b47f6eb.slice/crio-272d8f4d8f8c54fb1de8d8f50518e5f5805cc59a153fca3fd59ccdfd5a63fe21 WatchSource:0}: Error finding container 272d8f4d8f8c54fb1de8d8f50518e5f5805cc59a153fca3fd59ccdfd5a63fe21: Status 404 returned error can't find the container with id 272d8f4d8f8c54fb1de8d8f50518e5f5805cc59a153fca3fd59ccdfd5a63fe21
Jul 06 19:34:15.075812 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.075775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"
Jul 06 19:34:15.101156 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.101132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct"]
Jul 06 19:34:15.103636 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:15.103612    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbfa8ac_3a23_41d4_af49_77ce2462afa3.slice/crio-e670a4573d0b66e65de8eb348e432e4b69cb980fefab2cd3e0328458ed99767f WatchSource:0}: Error finding container e670a4573d0b66e65de8eb348e432e4b69cb980fefab2cd3e0328458ed99767f: Status 404 returned error can't find the container with id e670a4573d0b66e65de8eb348e432e4b69cb980fefab2cd3e0328458ed99767f
Jul 06 19:34:15.168836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.168795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp" event={"ID":"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb","Type":"ContainerStarted","Data":"272d8f4d8f8c54fb1de8d8f50518e5f5805cc59a153fca3fd59ccdfd5a63fe21"}
Jul 06 19:34:15.170028 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.169998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm" event={"ID":"7e168e64-735b-41fe-a639-22afd0798ac1","Type":"ContainerStarted","Data":"d4a4b395342fd4b0f9302b22a5a4cb142ff46beb6b191a2b3204ec1f77b0141e"}
Jul 06 19:34:15.171124 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.171104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct" event={"ID":"cdbfa8ac-3a23-41d4-af49-77ce2462afa3","Type":"ContainerStarted","Data":"e670a4573d0b66e65de8eb348e432e4b69cb980fefab2cd3e0328458ed99767f"}
Jul 06 19:34:15.198469 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.198443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc"]
Jul 06 19:34:15.200762 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:15.200738    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b11697_a9ae_4066_babd_7d3781699ced.slice/crio-ffd17b82d7dc6cdc0cc9771041aba9438c7dfd5b0dd037a106bf1e14849d843c WatchSource:0}: Error finding container ffd17b82d7dc6cdc0cc9771041aba9438c7dfd5b0dd037a106bf1e14849d843c: Status 404 returned error can't find the container with id ffd17b82d7dc6cdc0cc9771041aba9438c7dfd5b0dd037a106bf1e14849d843c
Jul 06 19:34:15.338522 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.338404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:15.338692 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:15.338506    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:15.338692 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:15.338619    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.338599132 +0000 UTC m=+85.126062153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:15.439581 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:15.439543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:15.439726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:15.439694    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:34:15.439726 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:15.439714    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc5d5869b-24bnv: secret "image-registry-tls" not found
Jul 06 19:34:15.439789 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:15.439770    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls podName:5ed41fa2-5d42-4ea1-9317-81ae348f521f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.439755205 +0000 UTC m=+85.227218225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls") pod "image-registry-fc5d5869b-24bnv" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f") : secret "image-registry-tls" not found
Jul 06 19:34:16.176335 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:16.176254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc" event={"ID":"41b11697-a9ae-4066-babd-7d3781699ced","Type":"ContainerStarted","Data":"ffd17b82d7dc6cdc0cc9771041aba9438c7dfd5b0dd037a106bf1e14849d843c"}
Jul 06 19:34:16.348959 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:16.348922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:16.349115 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:16.349064    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:16.349169 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:16.349135    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.349115444 +0000 UTC m=+87.136578465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:16.450030 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:16.449945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:16.450184 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:16.450124    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:34:16.450184 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:16.450147    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc5d5869b-24bnv: secret "image-registry-tls" not found
Jul 06 19:34:16.450284 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:16.450204    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls podName:5ed41fa2-5d42-4ea1-9317-81ae348f521f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.450188303 +0000 UTC m=+87.237651323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls") pod "image-registry-fc5d5869b-24bnv" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f") : secret "image-registry-tls" not found
Jul 06 19:34:17.181294 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:17.181260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm" event={"ID":"7e168e64-735b-41fe-a639-22afd0798ac1","Type":"ContainerStarted","Data":"aa25c76c60719c5536febabe58896152f0bd8fe99d89bef96dbe8ab92b67895c"}
Jul 06 19:34:17.202404 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:17.202343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kx6sm" podStartSLOduration=1.8328208 podStartE2EDuration="3.202322236s" totalImagesPullingTime="1.369501436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:17.200623718 +0000 UTC m=+85.988086760" watchObservedRunningTime="2026-07-06 19:34:17.202322236 +0000 UTC m=+85.989785280"
Jul 06 19:34:18.365553 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:18.365465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:18.366038 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:18.365620    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:18.366038 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:18.365703    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.365683447 +0000 UTC m=+91.153146486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:18.466685 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:18.466628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:18.466895 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:18.466820    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:34:18.466895 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:18.466848    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc5d5869b-24bnv: secret "image-registry-tls" not found
Jul 06 19:34:18.467006 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:18.466922    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls podName:5ed41fa2-5d42-4ea1-9317-81ae348f521f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:22.466899319 +0000 UTC m=+91.254362358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls") pod "image-registry-fc5d5869b-24bnv" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f") : secret "image-registry-tls" not found
Jul 06 19:34:19.189371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.189324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc" event={"ID":"41b11697-a9ae-4066-babd-7d3781699ced","Type":"ContainerStarted","Data":"ead15f01e387a03c5b2066035cc55b7b34cd188038c5ea32b77b526eab0f0ffd"}
Jul 06 19:34:19.195428 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.195391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct" event={"ID":"cdbfa8ac-3a23-41d4-af49-77ce2462afa3","Type":"ContainerStarted","Data":"bb0461ba7a442dc30d2442ca7b85bac71d261e2bcefc7dd4dda43b987baab05f"}
Jul 06 19:34:19.197005 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.196979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp" event={"ID":"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb","Type":"ContainerStarted","Data":"b228d9268cae5ff5178ed4a0612cea75edc75a575c81de72d0a89433ed09becc"}
Jul 06 19:34:19.209873 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.209813    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc" podStartSLOduration=2.128601312 podStartE2EDuration="5.209792638s" totalImagesPullingTime="3.081191326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:19.207960983 +0000 UTC m=+87.995424025" watchObservedRunningTime="2026-07-06 19:34:19.209792638 +0000 UTC m=+87.997255681"
Jul 06 19:34:19.233025 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.232965    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct" podStartSLOduration=2.065247119 podStartE2EDuration="5.232943449s" totalImagesPullingTime="3.16769633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:19.232391545 +0000 UTC m=+88.019854592" watchObservedRunningTime="2026-07-06 19:34:19.232943449 +0000 UTC m=+88.020406492"
Jul 06 19:34:19.256491 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:19.256409    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp" podStartSLOduration=1.98337736 podStartE2EDuration="5.256392827s" totalImagesPullingTime="3.273015467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:19.255051137 +0000 UTC m=+88.042514180" watchObservedRunningTime="2026-07-06 19:34:19.256392827 +0000 UTC m=+88.043855871"
Jul 06 19:34:20.285727 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.285685    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h7b22"]
Jul 06 19:34:20.289347 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.289320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.291868 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.291847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:34:20.292294 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.292272    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:34:20.292544 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.292528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-npgh8\""
Jul 06 19:34:20.302898 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.302869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7b22"]
Jul 06 19:34:20.383287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.383248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.383508 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.383298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.383508 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.383328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20516ce-c171-4e62-a376-49bcc8073222-data-volume\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.383508 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.383400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20516ce-c171-4e62-a376-49bcc8073222-crio-socket\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.383508 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.383448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9fzx\" (UniqueName: \"kubernetes.io/projected/c20516ce-c171-4e62-a376-49bcc8073222-kube-api-access-r9fzx\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484395 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484589 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484589 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20516ce-c171-4e62-a376-49bcc8073222-data-volume\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484589 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.484518    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:34:20.484589 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.484567    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:20.484589 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20516ce-c171-4e62-a376-49bcc8073222-crio-socket\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484811 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.484601    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:20.984578725 +0000 UTC m=+89.772041746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : configmap "kube-rbac-proxy" not found
Jul 06 19:34:20.484811 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484637    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20516ce-c171-4e62-a376-49bcc8073222-crio-socket\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484811 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.484646    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:20.984626814 +0000 UTC m=+89.772089837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:20.484811 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9fzx\" (UniqueName: \"kubernetes.io/projected/c20516ce-c171-4e62-a376-49bcc8073222-kube-api-access-r9fzx\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.484811 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.484798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20516ce-c171-4e62-a376-49bcc8073222-data-volume\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.494123 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.494089    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9fzx\" (UniqueName: \"kubernetes.io/projected/c20516ce-c171-4e62-a376-49bcc8073222-kube-api-access-r9fzx\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.524346 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.524315    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"]
Jul 06 19:34:20.526450 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.526430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"
Jul 06 19:34:20.530863 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.530827    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 19:34:20.530982 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.530966    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:20.531068 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.531014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x25ds\""
Jul 06 19:34:20.539657 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.539600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"]
Jul 06 19:34:20.585874 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.585839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmrbq\" (UniqueName: \"kubernetes.io/projected/d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2-kube-api-access-xmrbq\") pod \"migrator-d57d58cc9-78zr5\" (UID: \"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"
Jul 06 19:34:20.687271 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.687237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmrbq\" (UniqueName: \"kubernetes.io/projected/d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2-kube-api-access-xmrbq\") pod \"migrator-d57d58cc9-78zr5\" (UID: \"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"
Jul 06 19:34:20.696331 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.696303    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmrbq\" (UniqueName: \"kubernetes.io/projected/d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2-kube-api-access-xmrbq\") pod \"migrator-d57d58cc9-78zr5\" (UID: \"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"
Jul 06 19:34:20.836344 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.836261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"
Jul 06 19:34:20.966702 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.966680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5"]
Jul 06 19:34:20.968335 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:20.968307    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ea3e0e_273e_4a5c_a501_89b7e16a9ec2.slice/crio-030bb926fea84e379ec6c04de8eb025f4b662bfbabc66535ab07b84b615ae052 WatchSource:0}: Error finding container 030bb926fea84e379ec6c04de8eb025f4b662bfbabc66535ab07b84b615ae052: Status 404 returned error can't find the container with id 030bb926fea84e379ec6c04de8eb025f4b662bfbabc66535ab07b84b615ae052
Jul 06 19:34:20.990930 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.990898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.991079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:20.990943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:20.991079 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.991061    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:20.991188 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.991140    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:21.991115152 +0000 UTC m=+90.778578189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:20.991188 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.991067    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:34:20.991294 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:20.991197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:21.991184405 +0000 UTC m=+90.778647425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : configmap "kube-rbac-proxy" not found
Jul 06 19:34:21.208533 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.208436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5" event={"ID":"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2","Type":"ContainerStarted","Data":"030bb926fea84e379ec6c04de8eb025f4b662bfbabc66535ab07b84b615ae052"}
Jul 06 19:34:21.767933 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.767898    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mvz2z"]
Jul 06 19:34:21.770321 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.770298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.774122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.774100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 19:34:21.774240 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.774207    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 19:34:21.775345 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.775326    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 19:34:21.775456 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.775327    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 19:34:21.775456 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.775448    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qjrlb\""
Jul 06 19:34:21.784002 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.783980    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mvz2z"]
Jul 06 19:34:21.896556 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.896518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh4dr\" (UniqueName: \"kubernetes.io/projected/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-kube-api-access-qh4dr\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.896736 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.896573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-cabundle\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.896736 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.896607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-key\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.997114 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.997080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:21.997114 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.997122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-key\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.997332 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:21.997209    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:34:21.997332 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:21.997277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:23.997261301 +0000 UTC m=+92.784724321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : configmap "kube-rbac-proxy" not found
Jul 06 19:34:21.997434 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.997345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh4dr\" (UniqueName: \"kubernetes.io/projected/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-kube-api-access-qh4dr\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.997434 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.997370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:21.997434 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.997388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-cabundle\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.997604 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:21.997545    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:21.997649 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:21.997609    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:23.997593434 +0000 UTC m=+92.785056465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:21.998049 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.998031    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-cabundle\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:21.999442 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:21.999422    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-signing-key\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:22.006598 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.006569    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh4dr\" (UniqueName: \"kubernetes.io/projected/1dacd0c5-455d-4fa5-91bd-3ddedf7fe521-kube-api-access-qh4dr\") pod \"service-ca-758f599c5-mvz2z\" (UID: \"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521\") " pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:22.062566 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.062490    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6rfnr_b8461668-f6be-4f40-a905-72962797ced2/dns-node-resolver/0.log"
Jul 06 19:34:22.080778 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.080736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mvz2z"
Jul 06 19:34:22.400118 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.400086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:22.400243 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:22.400225    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:22.400299 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:22.400283    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.400268218 +0000 UTC m=+99.187731238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:22.405484 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.405437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mvz2z"]
Jul 06 19:34:22.408695 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:22.408670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dacd0c5_455d_4fa5_91bd_3ddedf7fe521.slice/crio-057daf753265a87d21362d0b2ad7970601194466f60c7d846a1cf6485792eabd WatchSource:0}: Error finding container 057daf753265a87d21362d0b2ad7970601194466f60c7d846a1cf6485792eabd: Status 404 returned error can't find the container with id 057daf753265a87d21362d0b2ad7970601194466f60c7d846a1cf6485792eabd
Jul 06 19:34:22.501108 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:22.501067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:22.501270 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:22.501224    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:34:22.501270 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:22.501244    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc5d5869b-24bnv: secret "image-registry-tls" not found
Jul 06 19:34:22.501375 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:22.501306    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls podName:5ed41fa2-5d42-4ea1-9317-81ae348f521f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:30.501292318 +0000 UTC m=+99.288755342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls") pod "image-registry-fc5d5869b-24bnv" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f") : secret "image-registry-tls" not found
Jul 06 19:34:23.217176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.217142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5" event={"ID":"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2","Type":"ContainerStarted","Data":"d7d7a6b45a964cc5df17a82402dbe098155b9518e666d0b7ef526138702bca48"}
Jul 06 19:34:23.217664 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.217203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5" event={"ID":"d2ea3e0e-273e-4a5c-a501-89b7e16a9ec2","Type":"ContainerStarted","Data":"be10e4b6236e35e333ff92e1fb3f2919d134e517fe7a3513838b949be6f1114c"}
Jul 06 19:34:23.222972 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.222939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mvz2z" event={"ID":"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521","Type":"ContainerStarted","Data":"c3587f6cd40506eb1b494ce8db1ed2b55488773dd7f3027cb2a1d71f5cfa8066"}
Jul 06 19:34:23.223081 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.223013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mvz2z" event={"ID":"1dacd0c5-455d-4fa5-91bd-3ddedf7fe521","Type":"ContainerStarted","Data":"057daf753265a87d21362d0b2ad7970601194466f60c7d846a1cf6485792eabd"}
Jul 06 19:34:23.240100 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.240050    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-78zr5" podStartSLOduration=1.931047041 podStartE2EDuration="3.240034514s" totalImagesPullingTime="1.308987473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:23.239540536 +0000 UTC m=+92.027003582" watchObservedRunningTime="2026-07-06 19:34:23.240034514 +0000 UTC m=+92.027497576"
Jul 06 19:34:23.261003 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.260955    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-mvz2z" podStartSLOduration=2.260941647 podStartE2EDuration="2.260941647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:23.259991417 +0000 UTC m=+92.047454456" watchObservedRunningTime="2026-07-06 19:34:23.260941647 +0000 UTC m=+92.048404689"
Jul 06 19:34:23.463371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:23.463344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4vht_66f3e19b-bc18-49be-a80c-0d8b141bc79b/node-ca/0.log"
Jul 06 19:34:24.011780 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:24.011732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:24.011989 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:24.011855    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:34:24.011989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:24.011868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:24.011989 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:24.011919    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:28.011903816 +0000 UTC m=+96.799366836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : configmap "kube-rbac-proxy" not found
Jul 06 19:34:24.012148 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:24.011995    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:24.012148 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:24.012066    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:28.012049427 +0000 UTC m=+96.799512461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:24.063012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:24.062985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gc5fz_91ac4c6f-507e-4a81-be9a-226217d18ebe/serve-healthcheck-canary/0.log"
Jul 06 19:34:28.046950 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:28.046916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:28.047338 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:28.046959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:28.047338 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:28.047063    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:34:28.047338 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:28.047071    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:28.047338 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:28.047128    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:36.047111727 +0000 UTC m=+104.834574755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:34:28.047338 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:28.047144    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm podName:c20516ce-c171-4e62-a376-49bcc8073222 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:36.047135926 +0000 UTC m=+104.834598949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7b22" (UID: "c20516ce-c171-4e62-a376-49bcc8073222") : configmap "kube-rbac-proxy" not found
Jul 06 19:34:30.466907 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:30.466817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:30.467330 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:30.466974    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 19:34:30.467330 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:30.467055    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert podName:55159b70-deb2-4ad4-ad61-f343a24ac3f2 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:46.467039612 +0000 UTC m=+115.254502636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmpdh" (UID: "55159b70-deb2-4ad4-ad61-f343a24ac3f2") : secret "networking-console-plugin-cert" not found
Jul 06 19:34:30.568211 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:30.568177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:30.570674 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:30.570646    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"image-registry-fc5d5869b-24bnv\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") " pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:30.694798 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:30.694760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:30.826214 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:30.826182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:34:30.829447 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:30.829416    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed41fa2_5d42_4ea1_9317_81ae348f521f.slice/crio-13fdf59853dd78d9c4b070ec61f9d3d36380beb9d6fa93830998a5d81e9ef17f WatchSource:0}: Error finding container 13fdf59853dd78d9c4b070ec61f9d3d36380beb9d6fa93830998a5d81e9ef17f: Status 404 returned error can't find the container with id 13fdf59853dd78d9c4b070ec61f9d3d36380beb9d6fa93830998a5d81e9ef17f
Jul 06 19:34:31.253010 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.252974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" event={"ID":"5ed41fa2-5d42-4ea1-9317-81ae348f521f","Type":"ContainerStarted","Data":"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"}
Jul 06 19:34:31.253194 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.253020    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" event={"ID":"5ed41fa2-5d42-4ea1-9317-81ae348f521f","Type":"ContainerStarted","Data":"13fdf59853dd78d9c4b070ec61f9d3d36380beb9d6fa93830998a5d81e9ef17f"}
Jul 06 19:34:31.253194 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.253092    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:31.286577 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.286530    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" podStartSLOduration=17.286515243 podStartE2EDuration="17.286515243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:31.284451408 +0000 UTC m=+100.071914454" watchObservedRunningTime="2026-07-06 19:34:31.286515243 +0000 UTC m=+100.073978313"
Jul 06 19:34:31.475252 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.475211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:34:31.477456 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.477433    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048ed20c-cce5-4626-ac6a-6cb9533bca15-metrics-tls\") pod \"dns-default-fqwkf\" (UID: \"048ed20c-cce5-4626-ac6a-6cb9533bca15\") " pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:34:31.509786 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.509720    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zq5lq\""
Jul 06 19:34:31.517122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.517102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:34:31.649347 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:31.649311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqwkf"]
Jul 06 19:34:31.652034 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:31.652005    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048ed20c_cce5_4626_ac6a_6cb9533bca15.slice/crio-edbcf3af800cb587409bb3cb2afacf753abf609a7d6e7e49a5613d6abf8ae5cb WatchSource:0}: Error finding container edbcf3af800cb587409bb3cb2afacf753abf609a7d6e7e49a5613d6abf8ae5cb: Status 404 returned error can't find the container with id edbcf3af800cb587409bb3cb2afacf753abf609a7d6e7e49a5613d6abf8ae5cb
Jul 06 19:34:32.258522 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:32.258467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqwkf" event={"ID":"048ed20c-cce5-4626-ac6a-6cb9533bca15","Type":"ContainerStarted","Data":"edbcf3af800cb587409bb3cb2afacf753abf609a7d6e7e49a5613d6abf8ae5cb"}
Jul 06 19:34:33.263701 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:33.263666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqwkf" event={"ID":"048ed20c-cce5-4626-ac6a-6cb9533bca15","Type":"ContainerStarted","Data":"3d459d12b21f59fa32497ea8f7b14d88e56fa583d1f865462563b002b1efce4e"}
Jul 06 19:34:34.142011 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:34.141983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wckz5"
Jul 06 19:34:34.268560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:34.268519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqwkf" event={"ID":"048ed20c-cce5-4626-ac6a-6cb9533bca15","Type":"ContainerStarted","Data":"57d8bd25f1c15b8c3354621912e80a38724567f5f62ad903d60546d09be6bac6"}
Jul 06 19:34:34.268953 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:34.268681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:34:34.290580 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:34.290525    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fqwkf" podStartSLOduration=65.850789576 podStartE2EDuration="1m7.290503251s" totalImagesPullingTime="1.439713675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:34.288953916 +0000 UTC m=+103.076416959" watchObservedRunningTime="2026-07-06 19:34:34.290503251 +0000 UTC m=+103.077966295"
Jul 06 19:34:36.116387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.116349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:36.116890 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.116396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:36.117064 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.117040    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20516ce-c171-4e62-a376-49bcc8073222-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:36.118648 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.118606    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20516ce-c171-4e62-a376-49bcc8073222-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7b22\" (UID: \"c20516ce-c171-4e62-a376-49bcc8073222\") " pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:36.199494 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.199435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7b22"
Jul 06 19:34:36.360732 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:36.360694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7b22"]
Jul 06 19:34:36.363439 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:36.363411    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20516ce_c171_4e62_a376_49bcc8073222.slice/crio-cff41cd2f2572268f03de226b837d84c9a123151f1ca221de870916725fd72d0 WatchSource:0}: Error finding container cff41cd2f2572268f03de226b837d84c9a123151f1ca221de870916725fd72d0: Status 404 returned error can't find the container with id cff41cd2f2572268f03de226b837d84c9a123151f1ca221de870916725fd72d0
Jul 06 19:34:37.283458 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:37.283423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7b22" event={"ID":"c20516ce-c171-4e62-a376-49bcc8073222","Type":"ContainerStarted","Data":"cff41cd2f2572268f03de226b837d84c9a123151f1ca221de870916725fd72d0"}
Jul 06 19:34:41.304650 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:41.304606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7b22" event={"ID":"c20516ce-c171-4e62-a376-49bcc8073222","Type":"ContainerStarted","Data":"c2c9cb4e2e967113126f3cb8259b8fd181ebd5b85ec8e24b26889f3e5677f73f"}
Jul 06 19:34:41.305051 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:41.304669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7b22" event={"ID":"c20516ce-c171-4e62-a376-49bcc8073222","Type":"ContainerStarted","Data":"3432bc1c896db1a28ce3dbcde1e3fd704f110c7c57875b450ab5a0a4b6996946"}
Jul 06 19:34:42.614342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:42.613395    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:34:43.313637 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:43.313606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7b22" event={"ID":"c20516ce-c171-4e62-a376-49bcc8073222","Type":"ContainerStarted","Data":"4b94912ea260936d3b5f4b1980ae8b79afc4152b9e9ac4d4b08c8e2ab5701480"}
Jul 06 19:34:43.334141 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:43.334093    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h7b22" podStartSLOduration=16.566854305 podStartE2EDuration="23.334078059s" totalImagesPullingTime="6.767223754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:34:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:43.333064373 +0000 UTC m=+112.120527417" watchObservedRunningTime="2026-07-06 19:34:43.334078059 +0000 UTC m=+112.121541100"
Jul 06 19:34:44.276574 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:44.276544    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fqwkf"
Jul 06 19:34:46.507642 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:46.507593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:46.510102 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:46.510071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55159b70-deb2-4ad4-ad61-f343a24ac3f2-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmpdh\" (UID: \"55159b70-deb2-4ad4-ad61-f343a24ac3f2\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:46.771818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:46.771725    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"
Jul 06 19:34:46.925649 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:46.925619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh"]
Jul 06 19:34:46.928875 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:46.928843    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55159b70_deb2_4ad4_ad61_f343a24ac3f2.slice/crio-ece15f7f5a8d90c24ea66ec32518941f50c8d6d73c2d8181339a5c64b994c1da WatchSource:0}: Error finding container ece15f7f5a8d90c24ea66ec32518941f50c8d6d73c2d8181339a5c64b994c1da: Status 404 returned error can't find the container with id ece15f7f5a8d90c24ea66ec32518941f50c8d6d73c2d8181339a5c64b994c1da
Jul 06 19:34:47.327765 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:47.327729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh" event={"ID":"55159b70-deb2-4ad4-ad61-f343a24ac3f2","Type":"ContainerStarted","Data":"ece15f7f5a8d90c24ea66ec32518941f50c8d6d73c2d8181339a5c64b994c1da"}
Jul 06 19:34:49.335376 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:49.335339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh" event={"ID":"55159b70-deb2-4ad4-ad61-f343a24ac3f2","Type":"ContainerStarted","Data":"7201b5ab524208a10271c07df33140011e99a2b6fab03e2c9b6cee62d2be0fc6"}
Jul 06 19:34:49.353420 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:49.353346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmpdh" podStartSLOduration=33.927622367 podStartE2EDuration="35.353328035s" totalImagesPullingTime="1.425705668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:49.35312338 +0000 UTC m=+118.140586422" watchObservedRunningTime="2026-07-06 19:34:49.353328035 +0000 UTC m=+118.140791078"
Jul 06 19:34:52.619455 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:52.619428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:34:57.095499 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.095450    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"]
Jul 06 19:34:57.100980 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.100958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.104158 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.104136    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:34:57.104408 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.104145    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:34:57.104497 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.104445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zhknw\""
Jul 06 19:34:57.104759 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.104744    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:34:57.104859 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.104757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 19:34:57.105555 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.105541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:34:57.111286 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.111086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"]
Jul 06 19:34:57.121279 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.121252    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"]
Jul 06 19:34:57.125015 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.124995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.128240 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.128072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:34:57.128357 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.128337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:34:57.128546 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.128432    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7rjz7\""
Jul 06 19:34:57.128778 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.128758    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:34:57.138007 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.137983    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s94sq"]
Jul 06 19:34:57.146529 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.146466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"]
Jul 06 19:34:57.146665 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.146588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.150163 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.150144    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4vfng\""
Jul 06 19:34:57.150275 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.150147    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:34:57.150275 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.150250    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:34:57.150489 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.150456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:34:57.189805 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.189776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq6l5\" (UniqueName: \"kubernetes.io/projected/9b589b86-9fa8-429b-bcd0-9d0006841132-kube-api-access-rq6l5\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.189805 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.189806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b589b86-9fa8-429b-bcd0-9d0006841132-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.190016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.189855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.190016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.189888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.291281 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-sys\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-textfile\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.291391    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxn7w\" (UniqueName: \"kubernetes.io/projected/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-kube-api-access-cxn7w\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.291524 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.291488    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls podName:9b589b86-9fa8-429b-bcd0-9d0006841132 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:57.791450718 +0000 UTC m=+126.578913746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-cfx9d" (UID: "9b589b86-9fa8-429b-bcd0-9d0006841132") : secret "openshift-state-metrics-tls" not found
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq6l5\" (UniqueName: \"kubernetes.io/projected/9b589b86-9fa8-429b-bcd0-9d0006841132-kube-api-access-rq6l5\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b589b86-9fa8-429b-bcd0-9d0006841132-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq5tc\" (UniqueName: \"kubernetes.io/projected/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-api-access-gq5tc\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.291926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-root\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.292345 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.291975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-metrics-client-ca\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.292345 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.292003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-wtmp\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.292345 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.292036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.292691 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.292668    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b589b86-9fa8-429b-bcd0-9d0006841132-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.294305 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.294284    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.300591 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.300569    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq6l5\" (UniqueName: \"kubernetes.io/projected/9b589b86-9fa8-429b-bcd0-9d0006841132-kube-api-access-rq6l5\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.393381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.393381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.393381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq5tc\" (UniqueName: \"kubernetes.io/projected/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-api-access-gq5tc\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.393381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-root\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-metrics-client-ca\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-wtmp\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393466    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-root\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.393457    2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.393569    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls podName:0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:57.893547164 +0000 UTC m=+126.681010195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-h6hdf" (UID: "0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752") : secret "kube-state-metrics-tls" not found
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393631    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-wtmp\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.393795 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.393727    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:34:57.393808    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls podName:a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:57.893789809 +0000 UTC m=+126.681252837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls") pod "node-exporter-s94sq" (UID: "a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0") : secret "node-exporter-tls" not found
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.393974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-sys\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-textfile\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394072    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-metrics-client-ca\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxn7w\" (UniqueName: \"kubernetes.io/projected/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-kube-api-access-cxn7w\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-sys\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394210    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394353    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-textfile\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.394560 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.394838 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.394760    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.395046 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.395027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.397120 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.397098    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.397196 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.397180    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.404985 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.404930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq5tc\" (UniqueName: \"kubernetes.io/projected/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-api-access-gq5tc\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.405400 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.405380    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxn7w\" (UniqueName: \"kubernetes.io/projected/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-kube-api-access-cxn7w\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.798277 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.798240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.800637 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.800618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b589b86-9fa8-429b-bcd0-9d0006841132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-cfx9d\" (UID: \"9b589b86-9fa8-429b-bcd0-9d0006841132\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:57.899377 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.899338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:57.899377 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.899384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.902021 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.901992    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0-node-exporter-tls\") pod \"node-exporter-s94sq\" (UID: \"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0\") " pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:57.902137 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:57.902119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h6hdf\" (UID: \"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:58.013462 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.013427    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"
Jul 06 19:34:58.035312 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.035290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"
Jul 06 19:34:58.056358 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.056294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s94sq"
Jul 06 19:34:58.070447 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:58.070417    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94d7aa4_86e3_4e3b_aeca_9b0701ee1fb0.slice/crio-eed619e14587d8c16fe7821bf8ba5f335439f00c5258cda27dc85684d927f76e WatchSource:0}: Error finding container eed619e14587d8c16fe7821bf8ba5f335439f00c5258cda27dc85684d927f76e: Status 404 returned error can't find the container with id eed619e14587d8c16fe7821bf8ba5f335439f00c5258cda27dc85684d927f76e
Jul 06 19:34:58.162523 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.162460    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d"]
Jul 06 19:34:58.165323 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:58.165279    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b589b86_9fa8_429b_bcd0_9d0006841132.slice/crio-02f58dd034bd15f7d72c5660b073a67e8d0a76e7246bff69293f576d23d485b4 WatchSource:0}: Error finding container 02f58dd034bd15f7d72c5660b073a67e8d0a76e7246bff69293f576d23d485b4: Status 404 returned error can't find the container with id 02f58dd034bd15f7d72c5660b073a67e8d0a76e7246bff69293f576d23d485b4
Jul 06 19:34:58.182771 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.182744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf"]
Jul 06 19:34:58.185158 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:58.185135    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed3ffd6_fdf2_4a87_b2b5_1d6b3edcf752.slice/crio-679d978a21e596e2b99b422dd006b6c088449a642e1eedb894e8ac28693531c3 WatchSource:0}: Error finding container 679d978a21e596e2b99b422dd006b6c088449a642e1eedb894e8ac28693531c3: Status 404 returned error can't find the container with id 679d978a21e596e2b99b422dd006b6c088449a642e1eedb894e8ac28693531c3
Jul 06 19:34:58.334601 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.334529    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:34:58.338558 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.338531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.341550 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 19:34:58.341550 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 19:34:58.341722 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341575    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 19:34:58.341722 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 19:34:58.341978 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341955    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 19:34:58.342076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n4rf5\""
Jul 06 19:34:58.342076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.342005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 19:34:58.342076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 19:34:58.342214 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.341966    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 19:34:58.343525 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.343510    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 19:34:58.360242 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.360215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:34:58.366972 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.366941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s94sq" event={"ID":"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0","Type":"ContainerStarted","Data":"eed619e14587d8c16fe7821bf8ba5f335439f00c5258cda27dc85684d927f76e"}
Jul 06 19:34:58.368890 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.368862    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d" event={"ID":"9b589b86-9fa8-429b-bcd0-9d0006841132","Type":"ContainerStarted","Data":"1eeba9d6923ff8a15761c36c5100b6b5d4c5060454559729f3e3115d9a23a445"}
Jul 06 19:34:58.369005 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.368920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d" event={"ID":"9b589b86-9fa8-429b-bcd0-9d0006841132","Type":"ContainerStarted","Data":"d19c965975abd50f1742dfe891088e48f8416a661f3e0acd34aa85da1f3ae7b2"}
Jul 06 19:34:58.369005 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.368949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d" event={"ID":"9b589b86-9fa8-429b-bcd0-9d0006841132","Type":"ContainerStarted","Data":"02f58dd034bd15f7d72c5660b073a67e8d0a76e7246bff69293f576d23d485b4"}
Jul 06 19:34:58.369990 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.369964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf" event={"ID":"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752","Type":"ContainerStarted","Data":"679d978a21e596e2b99b422dd006b6c088449a642e1eedb894e8ac28693531c3"}
Jul 06 19:34:58.504115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504115 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.504624 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.504547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jrxx\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605094 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605094 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605352 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jrxx\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.605720 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.605659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.606080 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.606045    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.606209 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.606184    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.606282 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.606240    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.608749 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.608695    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.609642 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.609300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.609642 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.609421    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.609642 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.609557    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.609857 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.609743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.609857 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.609752    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.610924 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.610883    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.611013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.610961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.611990 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.611949    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.616613 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.616574    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jrxx\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx\") pod \"alertmanager-main-0\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.649189 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.649158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:34:58.812354 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:58.812312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:34:59.040459 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:34:59.040417    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c832de_ec83_4386_a2ae_391ce198ce8d.slice/crio-fd2e5f3549ad3b89306a7c6bc518a3a66613635444f0a459f4f90ff0addf579f WatchSource:0}: Error finding container fd2e5f3549ad3b89306a7c6bc518a3a66613635444f0a459f4f90ff0addf579f: Status 404 returned error can't find the container with id fd2e5f3549ad3b89306a7c6bc518a3a66613635444f0a459f4f90ff0addf579f
Jul 06 19:34:59.375048 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:34:59.374958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"fd2e5f3549ad3b89306a7c6bc518a3a66613635444f0a459f4f90ff0addf579f"}
Jul 06 19:35:00.381771 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.381708    2578 generic.go:356] "Generic (PLEG): container finished" podID="a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0" containerID="618a20dd52990bf0b26d4da207879f749262a838e13ac8e256a0b2a9d0a36c5a" exitCode=0
Jul 06 19:35:00.382236 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.381818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s94sq" event={"ID":"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0","Type":"ContainerDied","Data":"618a20dd52990bf0b26d4da207879f749262a838e13ac8e256a0b2a9d0a36c5a"}
Jul 06 19:35:00.384590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.384530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d" event={"ID":"9b589b86-9fa8-429b-bcd0-9d0006841132","Type":"ContainerStarted","Data":"79832dec0432cbbab1748998ec28435b54b0bb6103c06bf97591cdf8f3b654d3"}
Jul 06 19:35:00.387606 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.387075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf" event={"ID":"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752","Type":"ContainerStarted","Data":"f4d666be395bc517664caac67dcb83f3897f06ec89c1cdb59f4f6e07419a4279"}
Jul 06 19:35:00.387606 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.387128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf" event={"ID":"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752","Type":"ContainerStarted","Data":"16183001328b332d13706068a6ffc5c3ac95c229644256cb9338bcef5a455437"}
Jul 06 19:35:00.387606 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.387157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf" event={"ID":"0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752","Type":"ContainerStarted","Data":"be7116ebee3753e0882edccaec6ac8bbe045724585d47be1278bdcdf5bf7f3dc"}
Jul 06 19:35:00.438045 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.437979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h6hdf" podStartSLOduration=1.962062843 podStartE2EDuration="3.437961006s" totalImagesPullingTime="1.475898163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:00.436100469 +0000 UTC m=+129.223563510" watchObservedRunningTime="2026-07-06 19:35:00.437961006 +0000 UTC m=+129.225424049"
Jul 06 19:35:00.470886 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:00.470802    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-cfx9d" podStartSLOduration=2.090036714 podStartE2EDuration="3.470780361s" totalImagesPullingTime="1.380743647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:00.470453095 +0000 UTC m=+129.257916138" watchObservedRunningTime="2026-07-06 19:35:00.470780361 +0000 UTC m=+129.258243404"
Jul 06 19:35:01.329883 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.329844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:35:01.332270 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.332242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8b59039-50e2-4592-b0b3-a6decb5f0f50-metrics-certs\") pod \"network-metrics-daemon-nr9l6\" (UID: \"c8b59039-50e2-4592-b0b3-a6decb5f0f50\") " pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:35:01.392318 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.392282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s94sq" event={"ID":"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0","Type":"ContainerStarted","Data":"7a649725e63df1481fbd48afa2c7262146b386408a9a581d44d13fe2d1cec11c"}
Jul 06 19:35:01.392815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.392337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s94sq" event={"ID":"a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0","Type":"ContainerStarted","Data":"637f09005604e4305bc1c1aac4987b4478743cf257060e96ba57d310f4518c27"}
Jul 06 19:35:01.393728 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.393705    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55" exitCode=0
Jul 06 19:35:01.393821 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.393793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"}
Jul 06 19:35:01.418774 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.418730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s94sq" podStartSLOduration=2.752604888 podStartE2EDuration="4.418715804s" totalImagesPullingTime="1.583612929s" totalInitContainerRuntime="82.497987ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:01.418649231 +0000 UTC m=+130.206112274" watchObservedRunningTime="2026-07-06 19:35:01.418715804 +0000 UTC m=+130.206178846"
Jul 06 19:35:01.473416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.473383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9cds\""
Jul 06 19:35:01.481332 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.481304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nr9l6"
Jul 06 19:35:01.613055 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.613026    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nr9l6"]
Jul 06 19:35:01.615068 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:35:01.615035    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b59039_50e2_4592_b0b3_a6decb5f0f50.slice/crio-9be7f27e6893c59a7159594c7b97f2775c8c58a3c21644795c7224bfe3a8a6b7 WatchSource:0}: Error finding container 9be7f27e6893c59a7159594c7b97f2775c8c58a3c21644795c7224bfe3a8a6b7: Status 404 returned error can't find the container with id 9be7f27e6893c59a7159594c7b97f2775c8c58a3c21644795c7224bfe3a8a6b7
Jul 06 19:35:01.896867 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.896786    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"]
Jul 06 19:35:01.901022 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.901005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:01.903987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.903963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ws2m5\""
Jul 06 19:35:01.904221 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.904202    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:35:01.911877 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:01.911851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"]
Jul 06 19:35:02.036113 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.036076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q7vb\" (UniqueName: \"kubernetes.io/projected/e101087b-af00-4377-994e-c6dac365623d-kube-api-access-6q7vb\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.036312 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.036142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e101087b-af00-4377-994e-c6dac365623d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.137610 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.137574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e101087b-af00-4377-994e-c6dac365623d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.137814 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.137624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q7vb\" (UniqueName: \"kubernetes.io/projected/e101087b-af00-4377-994e-c6dac365623d-kube-api-access-6q7vb\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.140057 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.140031    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e101087b-af00-4377-994e-c6dac365623d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.147011 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.146959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q7vb\" (UniqueName: \"kubernetes.io/projected/e101087b-af00-4377-994e-c6dac365623d-kube-api-access-6q7vb\") pod \"monitoring-plugin-d5dcff7cf-r8dmh\" (UID: \"e101087b-af00-4377-994e-c6dac365623d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.211874 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.211844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:02.361905 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.361878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"]
Jul 06 19:35:02.364254 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:35:02.364221    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode101087b_af00_4377_994e_c6dac365623d.slice/crio-98d269dc8576277a1681494bd82639369a962a5c7cbea1089b72553c943a4c21 WatchSource:0}: Error finding container 98d269dc8576277a1681494bd82639369a962a5c7cbea1089b72553c943a4c21: Status 404 returned error can't find the container with id 98d269dc8576277a1681494bd82639369a962a5c7cbea1089b72553c943a4c21
Jul 06 19:35:02.399084 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.398999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh" event={"ID":"e101087b-af00-4377-994e-c6dac365623d","Type":"ContainerStarted","Data":"98d269dc8576277a1681494bd82639369a962a5c7cbea1089b72553c943a4c21"}
Jul 06 19:35:02.400385 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:02.400359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nr9l6" event={"ID":"c8b59039-50e2-4592-b0b3-a6decb5f0f50","Type":"ContainerStarted","Data":"9be7f27e6893c59a7159594c7b97f2775c8c58a3c21644795c7224bfe3a8a6b7"}
Jul 06 19:35:03.080235 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.080199    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:35:03.083706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.083675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.087311 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.087285    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:35:03.087448 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.087290    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:35:03.087525 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.087499    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:35:03.089916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.088968    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:35:03.089916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.089163    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:35:03.089916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.089327    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:35:03.089916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.089537    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:35:03.089916 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.089748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2c6df\""
Jul 06 19:35:03.095545 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.095345    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:35:03.104001 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.103967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:35:03.148138 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148322 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148322 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148322 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148322 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148322 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bzj\" (UniqueName: \"kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.148625 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.148398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.249637 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.249601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bzj\" (UniqueName: \"kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.249830 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.249778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.249899 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.249832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.249899 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.249865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.250145 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.250223 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.250351 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.250689 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250669    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.250976 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.251023 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250990    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.251082 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.250991    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.252897 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.252872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.253318 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.253297    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.267683 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.267654    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bzj\" (UniqueName: \"kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj\") pod \"console-8469fb9ddd-7lbj7\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") " pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:03.397429 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:03.397344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:04.081978 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.081836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:35:04.089411 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:35:04.089382    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c4aa49_727d_46a9_8a18_cb3fb2ff8f66.slice/crio-92dbdf8205da8e0052141eebb3ba42adc22def74c918a03e4b375f5942ec2b55 WatchSource:0}: Error finding container 92dbdf8205da8e0052141eebb3ba42adc22def74c918a03e4b375f5942ec2b55: Status 404 returned error can't find the container with id 92dbdf8205da8e0052141eebb3ba42adc22def74c918a03e4b375f5942ec2b55
Jul 06 19:35:04.411922 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.411830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nr9l6" event={"ID":"c8b59039-50e2-4592-b0b3-a6decb5f0f50","Type":"ContainerStarted","Data":"b4cfb160e13cb4b051de135f36fff889f9e2ea7c33c1a79d4e95297da4e9ec82"}
Jul 06 19:35:04.411922 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.411888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nr9l6" event={"ID":"c8b59039-50e2-4592-b0b3-a6decb5f0f50","Type":"ContainerStarted","Data":"3c27f9d9267d85a0875ea37ec438beda2cf4a24a03ceda7609cd2c310ee25794"}
Jul 06 19:35:04.414760 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.414735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"}
Jul 06 19:35:04.414885 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.414799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"}
Jul 06 19:35:04.414885 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.414837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"}
Jul 06 19:35:04.414885 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.414863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"}
Jul 06 19:35:04.415019 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.414889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"}
Jul 06 19:35:04.416058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.416033    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh" event={"ID":"e101087b-af00-4377-994e-c6dac365623d","Type":"ContainerStarted","Data":"5d28ec0828b4e2ac474273f5d6f831d83cf9b2b2c48897f7560468e0a778e114"}
Jul 06 19:35:04.416171 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.416156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:04.417252 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.417232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8469fb9ddd-7lbj7" event={"ID":"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66","Type":"ContainerStarted","Data":"92dbdf8205da8e0052141eebb3ba42adc22def74c918a03e4b375f5942ec2b55"}
Jul 06 19:35:04.421200 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.421181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh"
Jul 06 19:35:04.436806 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.436760    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nr9l6" podStartSLOduration=131.134727329 podStartE2EDuration="2m13.436746171s" totalImagesPullingTime="2.302018842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:04.434829578 +0000 UTC m=+133.222292619" watchObservedRunningTime="2026-07-06 19:35:04.436746171 +0000 UTC m=+133.224209259"
Jul 06 19:35:04.454784 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:04.454738    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-r8dmh" podStartSLOduration=1.9019948530000002 podStartE2EDuration="3.454724968s" totalImagesPullingTime="1.552730115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:04.454466073 +0000 UTC m=+133.241929116" watchObservedRunningTime="2026-07-06 19:35:04.454724968 +0000 UTC m=+133.242188037"
Jul 06 19:35:05.423957 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:05.423919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerStarted","Data":"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"}
Jul 06 19:35:05.455485 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:05.455425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4565743429999998 podStartE2EDuration="7.455407364s" totalImagesPullingTime="4.979854496s" totalInitContainerRuntime="18.978525ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:05.454522145 +0000 UTC m=+134.241985184" watchObservedRunningTime="2026-07-06 19:35:05.455407364 +0000 UTC m=+134.242870408"
Jul 06 19:35:07.435458 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.435419    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8469fb9ddd-7lbj7" event={"ID":"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66","Type":"ContainerStarted","Data":"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"}
Jul 06 19:35:07.459722 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.459663    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8469fb9ddd-7lbj7" podStartSLOduration=1.3025224180000001 podStartE2EDuration="4.459646072s" totalImagesPullingTime="3.157123654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:07.458326238 +0000 UTC m=+136.245789281" watchObservedRunningTime="2026-07-06 19:35:07.459646072 +0000 UTC m=+136.247109113"
Jul 06 19:35:07.638723 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.638605    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" podUID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" containerName="registry" containerID="cri-o://d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534" gracePeriod=30
Jul 06 19:35:07.876813 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.876788    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:35:07.892680 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892614    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892680 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892686    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdwzw\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892837    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.892987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.892906    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates\") pod \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\" (UID: \"5ed41fa2-5d42-4ea1-9317-81ae348f521f\") "
Jul 06 19:35:07.893450 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.893377    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:07.893577 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.893448    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:07.895218 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.895121    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:07.895340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.895305    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw" (OuterVolumeSpecName: "kube-api-access-vdwzw") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "kube-api-access-vdwzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:07.895419 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.895363    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:07.895820 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.895570    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:07.895820 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.895632    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:07.901404 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.901378    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5ed41fa2-5d42-4ea1-9317-81ae348f521f" (UID: "5ed41fa2-5d42-4ea1-9317-81ae348f521f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:07.994371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994334    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-installation-pull-secrets\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994366    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ed41fa2-5d42-4ea1-9317-81ae348f521f-image-registry-private-configuration\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994376    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-certificates\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994630 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994387    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-registry-tls\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994630 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994397    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-bound-sa-token\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994630 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994405    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ed41fa2-5d42-4ea1-9317-81ae348f521f-ca-trust-extracted\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994630 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994415    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdwzw\" (UniqueName: \"kubernetes.io/projected/5ed41fa2-5d42-4ea1-9317-81ae348f521f-kube-api-access-vdwzw\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:07.994630 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:07.994425    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ed41fa2-5d42-4ea1-9317-81ae348f521f-trusted-ca\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:35:08.439753 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.439715    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" containerID="d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534" exitCode=0
Jul 06 19:35:08.440269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.439761    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv"
Jul 06 19:35:08.440269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.439800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" event={"ID":"5ed41fa2-5d42-4ea1-9317-81ae348f521f","Type":"ContainerDied","Data":"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"}
Jul 06 19:35:08.440269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.439854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc5d5869b-24bnv" event={"ID":"5ed41fa2-5d42-4ea1-9317-81ae348f521f","Type":"ContainerDied","Data":"13fdf59853dd78d9c4b070ec61f9d3d36380beb9d6fa93830998a5d81e9ef17f"}
Jul 06 19:35:08.440269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.439874    2578 scope.go:117] "RemoveContainer" containerID="d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"
Jul 06 19:35:08.451071 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.451052    2578 scope.go:117] "RemoveContainer" containerID="d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"
Jul 06 19:35:08.451366 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:35:08.451343    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534\": container with ID starting with d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534 not found: ID does not exist" containerID="d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"
Jul 06 19:35:08.451410 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.451375    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534"} err="failed to get container status \"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534\": rpc error: code = NotFound desc = could not find container \"d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534\": container with ID starting with d05c364f6b0ecc31bf93cab9bb0de18ad562446cad7d44a20c8d1e12f6af0534 not found: ID does not exist"
Jul 06 19:35:08.470879 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.470846    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:35:08.477122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:08.477098    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc5d5869b-24bnv"]
Jul 06 19:35:09.838028 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:09.837996    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" path="/var/lib/kubelet/pods/5ed41fa2-5d42-4ea1-9317-81ae348f521f/volumes"
Jul 06 19:35:13.398233 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:13.398195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:13.398761 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:13.398256    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:13.403086 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:13.403059    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:13.463253 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:13.463225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:35:29.521900 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:29.521868    2578 generic.go:356] "Generic (PLEG): container finished" podID="41b11697-a9ae-4066-babd-7d3781699ced" containerID="ead15f01e387a03c5b2066035cc55b7b34cd188038c5ea32b77b526eab0f0ffd" exitCode=0
Jul 06 19:35:29.522289 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:29.521916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc" event={"ID":"41b11697-a9ae-4066-babd-7d3781699ced","Type":"ContainerDied","Data":"ead15f01e387a03c5b2066035cc55b7b34cd188038c5ea32b77b526eab0f0ffd"}
Jul 06 19:35:29.522289 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:29.522245    2578 scope.go:117] "RemoveContainer" containerID="ead15f01e387a03c5b2066035cc55b7b34cd188038c5ea32b77b526eab0f0ffd"
Jul 06 19:35:30.528005 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:30.527970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-98pnc" event={"ID":"41b11697-a9ae-4066-babd-7d3781699ced","Type":"ContainerStarted","Data":"75e4b2049491a75573813e267abdcc5d7e5a16a93cb7e94ffa8b0b484acf8b32"}
Jul 06 19:35:44.583059 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:44.583018    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdbfa8ac-3a23-41d4-af49-77ce2462afa3" containerID="bb0461ba7a442dc30d2442ca7b85bac71d261e2bcefc7dd4dda43b987baab05f" exitCode=0
Jul 06 19:35:44.583488 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:44.583092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct" event={"ID":"cdbfa8ac-3a23-41d4-af49-77ce2462afa3","Type":"ContainerDied","Data":"bb0461ba7a442dc30d2442ca7b85bac71d261e2bcefc7dd4dda43b987baab05f"}
Jul 06 19:35:44.583488 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:44.583435    2578 scope.go:117] "RemoveContainer" containerID="bb0461ba7a442dc30d2442ca7b85bac71d261e2bcefc7dd4dda43b987baab05f"
Jul 06 19:35:45.588958 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:45.588922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-4mnct" event={"ID":"cdbfa8ac-3a23-41d4-af49-77ce2462afa3","Type":"ContainerStarted","Data":"2a0391ff8585ce04df25aa7723871499867284100e591888ccc77028cfb4e907"}
Jul 06 19:35:49.609658 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:49.609623    2578 generic.go:356] "Generic (PLEG): container finished" podID="f61458c5-d7c0-4c4f-bad2-413b1b47f6eb" containerID="b228d9268cae5ff5178ed4a0612cea75edc75a575c81de72d0a89433ed09becc" exitCode=0
Jul 06 19:35:49.610038 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:49.609673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp" event={"ID":"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb","Type":"ContainerDied","Data":"b228d9268cae5ff5178ed4a0612cea75edc75a575c81de72d0a89433ed09becc"}
Jul 06 19:35:49.610038 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:49.610016    2578 scope.go:117] "RemoveContainer" containerID="b228d9268cae5ff5178ed4a0612cea75edc75a575c81de72d0a89433ed09becc"
Jul 06 19:35:50.617020 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:35:50.616986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-dwmmp" event={"ID":"f61458c5-d7c0-4c4f-bad2-413b1b47f6eb","Type":"ContainerStarted","Data":"e0fd7f08dbb09ed0a5d5e15473042729caa0e6857dfc581d88966dca29d04f68"}
Jul 06 19:36:17.678256 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678221    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678515    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="alertmanager" containerID="cri-o://295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85" gracePeriod=120
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678608    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-web" containerID="cri-o://6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628" gracePeriod=120
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678601    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-metric" containerID="cri-o://c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf" gracePeriod=120
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678627    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="config-reloader" containerID="cri-o://a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023" gracePeriod=120
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678699    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="prom-label-proxy" containerID="cri-o://286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f" gracePeriod=120
Jul 06 19:36:17.678818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:17.678693    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy" containerID="cri-o://1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4" gracePeriod=120
Jul 06 19:36:18.744765 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744729    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f" exitCode=0
Jul 06 19:36:18.744765 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744756    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4" exitCode=0
Jul 06 19:36:18.744765 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744764    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023" exitCode=0
Jul 06 19:36:18.744765 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744772    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85" exitCode=0
Jul 06 19:36:18.745274 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"}
Jul 06 19:36:18.745274 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"}
Jul 06 19:36:18.745274 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"}
Jul 06 19:36:18.745274 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.744965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"}
Jul 06 19:36:18.921602 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:18.921573    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.008759 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.008759 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.008759 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008751    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009019 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009019 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009019 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008959    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009019 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.008998    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009087    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009112    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jrxx\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009212 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config\") pod \"c3c832de-ec83-4386-a2ae-391ce198ce8d\" (UID: \"c3c832de-ec83-4386-a2ae-391ce198ce8d\") "
Jul 06 19:36:19.009669 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.009642    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:19.011733 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.011353    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:19.012083 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.012005    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:36:19.012961 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.012929    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.013662 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.013626    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx" (OuterVolumeSpecName: "kube-api-access-4jrxx") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "kube-api-access-4jrxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:19.013791 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.013757    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.015505 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.015458    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume" (OuterVolumeSpecName: "config-volume") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.015678 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.015633    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.015963 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.015939    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out" (OuterVolumeSpecName: "config-out") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:19.016388 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.016361    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.016666 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.016636    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:19.018467 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.018440    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.025316 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.025290    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config" (OuterVolumeSpecName: "web-config") pod "c3c832de-ec83-4386-a2ae-391ce198ce8d" (UID: "c3c832de-ec83-4386-a2ae-391ce198ce8d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:36:19.110044 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110010    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-cluster-tls-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110044 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110042    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-volume\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110055    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110070    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110081    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-tls-assets\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110094    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-main-tls\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110104    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-main-db\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110116    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jrxx\" (UniqueName: \"kubernetes.io/projected/c3c832de-ec83-4386-a2ae-391ce198ce8d-kube-api-access-4jrxx\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110127    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-metrics-client-ca\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110141    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-web-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110152    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3c832de-ec83-4386-a2ae-391ce198ce8d-config-out\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110162    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c832de-ec83-4386-a2ae-391ce198ce8d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.110269 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.110174    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3c832de-ec83-4386-a2ae-391ce198ce8d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:36:19.751597 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751557    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf" exitCode=0
Jul 06 19:36:19.751597 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751592    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerID="6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628" exitCode=0
Jul 06 19:36:19.752033 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"}
Jul 06 19:36:19.752033 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751669    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.752033 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"}
Jul 06 19:36:19.752033 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3c832de-ec83-4386-a2ae-391ce198ce8d","Type":"ContainerDied","Data":"fd2e5f3549ad3b89306a7c6bc518a3a66613635444f0a459f4f90ff0addf579f"}
Jul 06 19:36:19.752033 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.751808    2578 scope.go:117] "RemoveContainer" containerID="286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"
Jul 06 19:36:19.762385 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.762364    2578 scope.go:117] "RemoveContainer" containerID="c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"
Jul 06 19:36:19.770076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.770057    2578 scope.go:117] "RemoveContainer" containerID="1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"
Jul 06 19:36:19.776715 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.776691    2578 scope.go:117] "RemoveContainer" containerID="6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"
Jul 06 19:36:19.779457 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.779435    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:19.783798 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.783772    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:19.784636 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.784618    2578 scope.go:117] "RemoveContainer" containerID="a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"
Jul 06 19:36:19.791911 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.791893    2578 scope.go:117] "RemoveContainer" containerID="295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"
Jul 06 19:36:19.799321 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.799160    2578 scope.go:117] "RemoveContainer" containerID="ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"
Jul 06 19:36:19.806511 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.806492    2578 scope.go:117] "RemoveContainer" containerID="286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"
Jul 06 19:36:19.806771 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.806747    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f\": container with ID starting with 286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f not found: ID does not exist" containerID="286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"
Jul 06 19:36:19.806817 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.806780    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"} err="failed to get container status \"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f\": rpc error: code = NotFound desc = could not find container \"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f\": container with ID starting with 286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f not found: ID does not exist"
Jul 06 19:36:19.806817 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.806802    2578 scope.go:117] "RemoveContainer" containerID="c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"
Jul 06 19:36:19.807046 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.807033    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf\": container with ID starting with c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf not found: ID does not exist" containerID="c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"
Jul 06 19:36:19.807096 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807049    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"} err="failed to get container status \"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf\": rpc error: code = NotFound desc = could not find container \"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf\": container with ID starting with c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf not found: ID does not exist"
Jul 06 19:36:19.807096 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807060    2578 scope.go:117] "RemoveContainer" containerID="1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"
Jul 06 19:36:19.807267 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.807246    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4\": container with ID starting with 1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4 not found: ID does not exist" containerID="1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"
Jul 06 19:36:19.807335 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807277    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"} err="failed to get container status \"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4\": rpc error: code = NotFound desc = could not find container \"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4\": container with ID starting with 1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4 not found: ID does not exist"
Jul 06 19:36:19.807335 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807302    2578 scope.go:117] "RemoveContainer" containerID="6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"
Jul 06 19:36:19.807681 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.807666    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628\": container with ID starting with 6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628 not found: ID does not exist" containerID="6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"
Jul 06 19:36:19.807737 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807684    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"} err="failed to get container status \"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628\": rpc error: code = NotFound desc = could not find container \"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628\": container with ID starting with 6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628 not found: ID does not exist"
Jul 06 19:36:19.807737 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807697    2578 scope.go:117] "RemoveContainer" containerID="a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"
Jul 06 19:36:19.807934 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.807915    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023\": container with ID starting with a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023 not found: ID does not exist" containerID="a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"
Jul 06 19:36:19.807979 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807940    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"} err="failed to get container status \"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023\": rpc error: code = NotFound desc = could not find container \"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023\": container with ID starting with a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023 not found: ID does not exist"
Jul 06 19:36:19.807979 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.807955    2578 scope.go:117] "RemoveContainer" containerID="295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"
Jul 06 19:36:19.808154 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.808139    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85\": container with ID starting with 295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85 not found: ID does not exist" containerID="295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"
Jul 06 19:36:19.808192 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808156    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"} err="failed to get container status \"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85\": rpc error: code = NotFound desc = could not find container \"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85\": container with ID starting with 295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85 not found: ID does not exist"
Jul 06 19:36:19.808192 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808167    2578 scope.go:117] "RemoveContainer" containerID="ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"
Jul 06 19:36:19.808346 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:36:19.808328    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55\": container with ID starting with ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55 not found: ID does not exist" containerID="ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"
Jul 06 19:36:19.808386 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808351    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"} err="failed to get container status \"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55\": rpc error: code = NotFound desc = could not find container \"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55\": container with ID starting with ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55 not found: ID does not exist"
Jul 06 19:36:19.808386 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808362    2578 scope.go:117] "RemoveContainer" containerID="286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"
Jul 06 19:36:19.808562 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808547    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f"} err="failed to get container status \"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f\": rpc error: code = NotFound desc = could not find container \"286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f\": container with ID starting with 286c24a26b04ca6a08ffd83541e7b0fa844e46e3bcd3174547741c481bb6f13f not found: ID does not exist"
Jul 06 19:36:19.808607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808563    2578 scope.go:117] "RemoveContainer" containerID="c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"
Jul 06 19:36:19.808788 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808768    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf"} err="failed to get container status \"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf\": rpc error: code = NotFound desc = could not find container \"c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf\": container with ID starting with c91de62dc11373a2fd20681133be13ed75da8a33a0ef887f84e4adddd5865fdf not found: ID does not exist"
Jul 06 19:36:19.808831 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808791    2578 scope.go:117] "RemoveContainer" containerID="1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"
Jul 06 19:36:19.808988 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808971    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4"} err="failed to get container status \"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4\": rpc error: code = NotFound desc = could not find container \"1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4\": container with ID starting with 1a89908611112471605f53356f9cb70f4133407bea3c8a6809194147acf273b4 not found: ID does not exist"
Jul 06 19:36:19.809032 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.808990    2578 scope.go:117] "RemoveContainer" containerID="6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"
Jul 06 19:36:19.809178 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809162    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628"} err="failed to get container status \"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628\": rpc error: code = NotFound desc = could not find container \"6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628\": container with ID starting with 6daf99e37b7093a9be21316214bf059bc4d16d2606ecb84ba2d2d0bdfba1d628 not found: ID does not exist"
Jul 06 19:36:19.809220 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809178    2578 scope.go:117] "RemoveContainer" containerID="a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"
Jul 06 19:36:19.809401 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809383    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023"} err="failed to get container status \"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023\": rpc error: code = NotFound desc = could not find container \"a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023\": container with ID starting with a1d3989b89c75099fd38ef58c56575e901b3e248286fed45e35c834bcd7ee023 not found: ID does not exist"
Jul 06 19:36:19.809443 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809403    2578 scope.go:117] "RemoveContainer" containerID="295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"
Jul 06 19:36:19.809633 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809615    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85"} err="failed to get container status \"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85\": rpc error: code = NotFound desc = could not find container \"295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85\": container with ID starting with 295a8062be47278d92ee212ccf1b9cc234064a6e7d68907c15cd2230236f8e85 not found: ID does not exist"
Jul 06 19:36:19.809686 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809633    2578 scope.go:117] "RemoveContainer" containerID="ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"
Jul 06 19:36:19.809845 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.809829    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55"} err="failed to get container status \"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55\": rpc error: code = NotFound desc = could not find container \"ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55\": container with ID starting with ca3ebfeb80d5da31640948d29cd65d0b3bdb5ce70beaf7b5584dde7e0084ce55 not found: ID does not exist"
Jul 06 19:36:19.816309 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816287    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:19.816590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816577    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="alertmanager"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816591    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="alertmanager"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816601    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816607    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816618    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="prom-label-proxy"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816623    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="prom-label-proxy"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816630    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="init-config-reloader"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816636    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="init-config-reloader"
Jul 06 19:36:19.816646 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816645    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" containerName="registry"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816650    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" containerName="registry"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816659    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="config-reloader"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816664    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="config-reloader"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816672    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-web"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816678    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-web"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-metric"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816689    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-metric"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816734    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="alertmanager"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816741    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="prom-label-proxy"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816747    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="config-reloader"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816760    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed41fa2-5d42-4ea1-9317-81ae348f521f" containerName="registry"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816767    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-metric"
Jul 06 19:36:19.816870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.816772    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" containerName="kube-rbac-proxy-web"
Jul 06 19:36:19.820593 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.820574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.828678 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.828654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 19:36:19.828764 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.828654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 19:36:19.828764 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.828684    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 19:36:19.828851 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.828800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n4rf5\""
Jul 06 19:36:19.829332 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.829318    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 19:36:19.830634 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.830618    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 19:36:19.831367 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.831352    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 19:36:19.831978 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.831962    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 19:36:19.832055 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.831995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 19:36:19.836526 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.836401    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 19:36:19.839199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.839177    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3c832de-ec83-4386-a2ae-391ce198ce8d" path="/var/lib/kubelet/pods/c3c832de-ec83-4386-a2ae-391ce198ce8d/volumes"
Jul 06 19:36:19.839707 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.839687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:19.916993 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.916953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-config-volume\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-web-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-config-out\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nplt\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-kube-api-access-2nplt\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:19.917374 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:19.917342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018339 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018339 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018339 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-config-volume\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-web-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018611 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-config-out\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018965 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nplt\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-kube-api-access-2nplt\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018965 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.018965 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.018698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.019773 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.019417    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.019773 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.019644    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.020289 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.020237    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11640270-899e-4f4d-893f-02611cd85593-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.021585 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.021395    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.021585 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.021539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.021835 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.021784    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-config-volume\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.022152 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.022131    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.022217 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.022135    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11640270-899e-4f4d-893f-02611cd85593-config-out\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.022258 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.022247    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.022293 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.022246    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.023025 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.023007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.023285 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.023271    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11640270-899e-4f4d-893f-02611cd85593-web-config\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.028999 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.028974    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nplt\" (UniqueName: \"kubernetes.io/projected/11640270-899e-4f4d-893f-02611cd85593-kube-api-access-2nplt\") pod \"alertmanager-main-0\" (UID: \"11640270-899e-4f4d-893f-02611cd85593\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.129298 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.129254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 19:36:20.271359 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.271276    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 19:36:20.274682 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:36:20.274650    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11640270_899e_4f4d_893f_02611cd85593.slice/crio-2ccce22b16bf5faac6820b0bbc17f269ace6b02a17184d11d754d786f09cacdd WatchSource:0}: Error finding container 2ccce22b16bf5faac6820b0bbc17f269ace6b02a17184d11d754d786f09cacdd: Status 404 returned error can't find the container with id 2ccce22b16bf5faac6820b0bbc17f269ace6b02a17184d11d754d786f09cacdd
Jul 06 19:36:20.757632 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.757600    2578 generic.go:356] "Generic (PLEG): container finished" podID="11640270-899e-4f4d-893f-02611cd85593" containerID="9a8511a88b8e9073e6890332c14e5577634e668e6517d7212af59afa1024b4d2" exitCode=0
Jul 06 19:36:20.758012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.757665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerDied","Data":"9a8511a88b8e9073e6890332c14e5577634e668e6517d7212af59afa1024b4d2"}
Jul 06 19:36:20.758012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:20.757742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"2ccce22b16bf5faac6820b0bbc17f269ace6b02a17184d11d754d786f09cacdd"}
Jul 06 19:36:21.716613 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.716582    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-797cffff98-w2d9h"]
Jul 06 19:36:21.719318 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.719294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.722041 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4vm22\""
Jul 06 19:36:21.722659 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722638    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 19:36:21.722767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 19:36:21.722767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 19:36:21.722767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 19:36:21.722937 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.722793    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 19:36:21.730741 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.730722    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 19:36:21.738181 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.738157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-797cffff98-w2d9h"]
Jul 06 19:36:21.766134 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"d67c76af238f6dd69b6a126594d2b47a9296c7d36b1d49a494f3c1d116b87bcd"}
Jul 06 19:36:21.766507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"e2f3f1e4d555381ec9d6e565482167ac070ccd559cd5cf8f0ef16cb56391cd6c"}
Jul 06 19:36:21.766507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766191    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"7b2c8dbb469214d2a142b4b1ed5202b6bd3a6489c97df5d75d98213317ae6e9d"}
Jul 06 19:36:21.766507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"00b34702c12fafeaa4e83afcc638def1d1af612fb866f359e546d313f5b8ebb6"}
Jul 06 19:36:21.766507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"09305fc60f37d24ab9beaf4b31519da8042089a5091e000b04e0b3b88abb8b80"}
Jul 06 19:36:21.766507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.766267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11640270-899e-4f4d-893f-02611cd85593","Type":"ContainerStarted","Data":"b6f5e526174e1469bf01b18fa562919ee573a496994b960ee4d9b87ba537ba27"}
Jul 06 19:36:21.811764 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.811711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.796838028 podStartE2EDuration="2.811692178s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.85415ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:21.809952478 +0000 UTC m=+210.597415536" watchObservedRunningTime="2026-07-06 19:36:21.811692178 +0000 UTC m=+210.599155221"
Jul 06 19:36:21.833583 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833583 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-federate-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833819 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833819 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-metrics-client-ca\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833819 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-serving-certs-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833819 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.833819 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tsx4\" (UniqueName: \"kubernetes.io/projected/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-kube-api-access-8tsx4\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.834073 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.833997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.934897 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.934859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.934897 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.934900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tsx4\" (UniqueName: \"kubernetes.io/projected/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-kube-api-access-8tsx4\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.934953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.934994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-federate-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935177 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-metrics-client-ca\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935422 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-serving-certs-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.935956 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-serving-certs-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.936076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.935942    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.936076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.936035    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-metrics-client-ca\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.937714 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.937688    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-telemeter-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.937792 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.937720    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.937827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.937799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.937990 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.937959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-federate-client-tls\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:21.944580 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:21.944560    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tsx4\" (UniqueName: \"kubernetes.io/projected/ecf0af97-94b2-49c4-a9da-2f1d79eb128b-kube-api-access-8tsx4\") pod \"telemeter-client-797cffff98-w2d9h\" (UID: \"ecf0af97-94b2-49c4-a9da-2f1d79eb128b\") " pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:22.030884 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:22.030854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h"
Jul 06 19:36:22.168002 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:22.167977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-797cffff98-w2d9h"]
Jul 06 19:36:22.169723 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:36:22.169696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf0af97_94b2_49c4_a9da_2f1d79eb128b.slice/crio-1cfeebb37c823087ddc6c3ec21764ff7689232567af0d10caf16ffa6ae7862e7 WatchSource:0}: Error finding container 1cfeebb37c823087ddc6c3ec21764ff7689232567af0d10caf16ffa6ae7862e7: Status 404 returned error can't find the container with id 1cfeebb37c823087ddc6c3ec21764ff7689232567af0d10caf16ffa6ae7862e7
Jul 06 19:36:22.771883 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:22.771834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h" event={"ID":"ecf0af97-94b2-49c4-a9da-2f1d79eb128b","Type":"ContainerStarted","Data":"1cfeebb37c823087ddc6c3ec21764ff7689232567af0d10caf16ffa6ae7862e7"}
Jul 06 19:36:24.782315 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:24.782274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h" event={"ID":"ecf0af97-94b2-49c4-a9da-2f1d79eb128b","Type":"ContainerStarted","Data":"261cf9216fc6c99076dd33c4ac8b98c8cbac7da3021137f03422733e3e22fbc0"}
Jul 06 19:36:24.782718 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:24.782347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h" event={"ID":"ecf0af97-94b2-49c4-a9da-2f1d79eb128b","Type":"ContainerStarted","Data":"347e1761b0a3765a901cdb96992690b597bc478f4d78ffeacc526abe9860a0a1"}
Jul 06 19:36:24.782718 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:24.782380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h" event={"ID":"ecf0af97-94b2-49c4-a9da-2f1d79eb128b","Type":"ContainerStarted","Data":"47d1553bb70dca33aee1a8afc01da23a0942239a499bd2ba1e852381adc83284"}
Jul 06 19:36:24.809802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:24.809754    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-797cffff98-w2d9h" podStartSLOduration=1.71067494 podStartE2EDuration="3.809737393s" totalImagesPullingTime="2.099062453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:24.807327199 +0000 UTC m=+213.594790244" watchObservedRunningTime="2026-07-06 19:36:24.809737393 +0000 UTC m=+213.597200435"
Jul 06 19:36:25.591908 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.591865    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:36:25.594146 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.594128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.611016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.610983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:36:25.672191 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672191 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672437 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672437 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672437 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2t2n\" (UniqueName: \"kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.672590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.672510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773455 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773455 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773671 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773671 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773671 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773829 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2t2n\" (UniqueName: \"kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.773829 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.773723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.774456 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.774421    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.774590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.774506    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.774590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.774523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.774590 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.774533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.775934 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.775906    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.776045 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.775981    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.783418 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.783395    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2t2n\" (UniqueName: \"kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n\") pod \"console-59b89d8c58-725gp\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") " pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:25.903842 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:25.903755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:26.036218 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:26.036181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:36:26.039464 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:36:26.039435    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0965f0_db1f_44f0_b192_2907642b2051.slice/crio-d2e90f0a94c6b57169317722286b677d874382681573b9998a4d7fbc6c3b0300 WatchSource:0}: Error finding container d2e90f0a94c6b57169317722286b677d874382681573b9998a4d7fbc6c3b0300: Status 404 returned error can't find the container with id d2e90f0a94c6b57169317722286b677d874382681573b9998a4d7fbc6c3b0300
Jul 06 19:36:26.793791 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:26.793750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b89d8c58-725gp" event={"ID":"ec0965f0-db1f-44f0-b192-2907642b2051","Type":"ContainerStarted","Data":"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"}
Jul 06 19:36:26.794187 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:26.793827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b89d8c58-725gp" event={"ID":"ec0965f0-db1f-44f0-b192-2907642b2051","Type":"ContainerStarted","Data":"d2e90f0a94c6b57169317722286b677d874382681573b9998a4d7fbc6c3b0300"}
Jul 06 19:36:26.817494 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:26.817416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b89d8c58-725gp" podStartSLOduration=1.8173994549999999 podStartE2EDuration="1.817399455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:26.817037866 +0000 UTC m=+215.604500899" watchObservedRunningTime="2026-07-06 19:36:26.817399455 +0000 UTC m=+215.604862497"
Jul 06 19:36:35.904076 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:35.904040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:35.904531 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:35.904105    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:35.908906 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:35.908881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:36.837276 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:36.837244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:36:36.949349 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:36:36.949312    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:37:01.970739 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:01.970679    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8469fb9ddd-7lbj7" podUID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" containerName="console" containerID="cri-o://e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a" gracePeriod=15
Jul 06 19:37:02.215354 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.215327    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:37:02.284338 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284338 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284344    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74bzj\" (UniqueName: \"kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284607 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284511    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config\") pod \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\" (UID: \"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66\") "
Jul 06 19:37:02.284947 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284915    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:02.285119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284950    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config" (OuterVolumeSpecName: "console-config") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:02.285119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.284965    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:02.285119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.285030    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca" (OuterVolumeSpecName: "service-ca") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:02.286740 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.286710    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj" (OuterVolumeSpecName: "kube-api-access-74bzj") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "kube-api-access-74bzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:02.286740 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.286729    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:02.286863 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.286824    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" (UID: "44c4aa49-727d-46a9-8a18-cb3fb2ff8f66"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:02.385424 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385381    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-trusted-ca-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385424 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385417    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385424 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385426    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-oauth-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385435    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-service-ca\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385444    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74bzj\" (UniqueName: \"kubernetes.io/projected/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-kube-api-access-74bzj\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385453    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-oauth-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.385668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.385461    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66-console-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.937540 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.937505    2578 generic.go:356] "Generic (PLEG): container finished" podID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" containerID="e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a" exitCode=0
Jul 06 19:37:02.937706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.937548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8469fb9ddd-7lbj7" event={"ID":"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66","Type":"ContainerDied","Data":"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"}
Jul 06 19:37:02.937706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.937600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8469fb9ddd-7lbj7" event={"ID":"44c4aa49-727d-46a9-8a18-cb3fb2ff8f66","Type":"ContainerDied","Data":"92dbdf8205da8e0052141eebb3ba42adc22def74c918a03e4b375f5942ec2b55"}
Jul 06 19:37:02.937706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.937610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8469fb9ddd-7lbj7"
Jul 06 19:37:02.937706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.937627    2578 scope.go:117] "RemoveContainer" containerID="e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"
Jul 06 19:37:02.946547 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.946527    2578 scope.go:117] "RemoveContainer" containerID="e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"
Jul 06 19:37:02.946799 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:37:02.946781    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a\": container with ID starting with e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a not found: ID does not exist" containerID="e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"
Jul 06 19:37:02.946849 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.946807    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a"} err="failed to get container status \"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a\": rpc error: code = NotFound desc = could not find container \"e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a\": container with ID starting with e9a3e61ed3d86a9a213eb79c167effa44a5979f649aa6d9c964d025b674b284a not found: ID does not exist"
Jul 06 19:37:02.965327 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.965300    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:37:02.971304 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:02.971268    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8469fb9ddd-7lbj7"]
Jul 06 19:37:03.838719 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:03.838681    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" path="/var/lib/kubelet/pods/44c4aa49-727d-46a9-8a18-cb3fb2ff8f66/volumes"
Jul 06 19:37:38.904052 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.903982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:37:38.904496 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.904357    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" containerName="console"
Jul 06 19:37:38.904496 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.904369    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" containerName="console"
Jul 06 19:37:38.904496 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.904432    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="44c4aa49-727d-46a9-8a18-cb3fb2ff8f66" containerName="console"
Jul 06 19:37:38.907634 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.907598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:38.924802 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:38.924771    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:37:39.092166 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092166 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffr5l\" (UniqueName: \"kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092391 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092391 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092391 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092391 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.092391 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.092336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.192981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193058 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffr5l\" (UniqueName: \"kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193815 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193790    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193928 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193867    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.193984 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.193926    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.194313 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.194289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.195529 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.195502    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.195641 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.195623    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.201982 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.201953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffr5l\" (UniqueName: \"kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l\") pod \"console-745746d4d6-2kkwf\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") " pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.216772 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.216744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:39.352395 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:39.352248    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:37:39.355064 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:37:39.355034    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd84c4a_00b4_4920_a800_02b600c85cd7.slice/crio-8baa31ac3f62457c52b1263ff5c5adbf67862a42b3a3495f5c3898351aedf494 WatchSource:0}: Error finding container 8baa31ac3f62457c52b1263ff5c5adbf67862a42b3a3495f5c3898351aedf494: Status 404 returned error can't find the container with id 8baa31ac3f62457c52b1263ff5c5adbf67862a42b3a3495f5c3898351aedf494
Jul 06 19:37:40.088358 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:40.088320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745746d4d6-2kkwf" event={"ID":"ddd84c4a-00b4-4920-a800-02b600c85cd7","Type":"ContainerStarted","Data":"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"}
Jul 06 19:37:40.088777 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:40.088374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745746d4d6-2kkwf" event={"ID":"ddd84c4a-00b4-4920-a800-02b600c85cd7","Type":"ContainerStarted","Data":"8baa31ac3f62457c52b1263ff5c5adbf67862a42b3a3495f5c3898351aedf494"}
Jul 06 19:37:40.110713 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:40.110663    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745746d4d6-2kkwf" podStartSLOduration=2.110647555 podStartE2EDuration="2.110647555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:40.109219652 +0000 UTC m=+288.896682704" watchObservedRunningTime="2026-07-06 19:37:40.110647555 +0000 UTC m=+288.898110597"
Jul 06 19:37:49.217879 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:49.217846    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:49.218453 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:49.217950    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:49.222719 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:49.222698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:50.133014 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:50.132978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:37:50.184240 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:50.184203    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:37:51.644622 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:37:51.644596    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:38:15.211662 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.211620    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59b89d8c58-725gp" podUID="ec0965f0-db1f-44f0-b192-2907642b2051" containerName="console" containerID="cri-o://d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b" gracePeriod=15
Jul 06 19:38:15.459807 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.459776    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:38:15.589810 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589858    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2t2n\" (UniqueName: \"kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590013 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.589982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert\") pod \"ec0965f0-db1f-44f0-b192-2907642b2051\" (UID: \"ec0965f0-db1f-44f0-b192-2907642b2051\") "
Jul 06 19:38:15.590381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.590354    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:15.590446 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.590401    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:15.590446 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.590397    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:15.590594 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.590539    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config" (OuterVolumeSpecName: "console-config") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:15.592099 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.592074    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n" (OuterVolumeSpecName: "kube-api-access-s2t2n") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "kube-api-access-s2t2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:15.592179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.592093    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:38:15.592179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.592074    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec0965f0-db1f-44f0-b192-2907642b2051" (UID: "ec0965f0-db1f-44f0-b192-2907642b2051"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:38:15.691465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691426    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-trusted-ca-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691457    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-oauth-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691469    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-service-ca\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691491    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-console-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691465 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691499    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2t2n\" (UniqueName: \"kubernetes.io/projected/ec0965f0-db1f-44f0-b192-2907642b2051-kube-api-access-s2t2n\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691763 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691507    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec0965f0-db1f-44f0-b192-2907642b2051-oauth-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:15.691763 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:15.691516    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec0965f0-db1f-44f0-b192-2907642b2051-console-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:16.231773 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.231690    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec0965f0-db1f-44f0-b192-2907642b2051" containerID="d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b" exitCode=0
Jul 06 19:38:16.231773 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.231751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b89d8c58-725gp"
Jul 06 19:38:16.232206 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.231765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b89d8c58-725gp" event={"ID":"ec0965f0-db1f-44f0-b192-2907642b2051","Type":"ContainerDied","Data":"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"}
Jul 06 19:38:16.232206 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.231817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b89d8c58-725gp" event={"ID":"ec0965f0-db1f-44f0-b192-2907642b2051","Type":"ContainerDied","Data":"d2e90f0a94c6b57169317722286b677d874382681573b9998a4d7fbc6c3b0300"}
Jul 06 19:38:16.232206 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.231837    2578 scope.go:117] "RemoveContainer" containerID="d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"
Jul 06 19:38:16.240347 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.240330    2578 scope.go:117] "RemoveContainer" containerID="d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"
Jul 06 19:38:16.240624 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:38:16.240605    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b\": container with ID starting with d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b not found: ID does not exist" containerID="d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"
Jul 06 19:38:16.240675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.240635    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b"} err="failed to get container status \"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b\": rpc error: code = NotFound desc = could not find container \"d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b\": container with ID starting with d73f16b4cc5e4604f9e6cbe12a166fd72f12b4677431366b5f1f1c01b410452b not found: ID does not exist"
Jul 06 19:38:16.248961 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.248930    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:38:16.252647 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:16.252618    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b89d8c58-725gp"]
Jul 06 19:38:17.838341 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:17.838309    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0965f0-db1f-44f0-b192-2907642b2051" path="/var/lib/kubelet/pods/ec0965f0-db1f-44f0-b192-2907642b2051/volumes"
Jul 06 19:38:23.293315 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.293275    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"]
Jul 06 19:38:23.293826 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.293635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0965f0-db1f-44f0-b192-2907642b2051" containerName="console"
Jul 06 19:38:23.293826 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.293646    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0965f0-db1f-44f0-b192-2907642b2051" containerName="console"
Jul 06 19:38:23.293826 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.293711    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0965f0-db1f-44f0-b192-2907642b2051" containerName="console"
Jul 06 19:38:23.298188 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.298166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.301307 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.301283    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:38:23.301426 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.301286    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:38:23.302332 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.302312    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zckv\""
Jul 06 19:38:23.309463 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.309438    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"]
Jul 06 19:38:23.459091 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.459037    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.459307 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.459180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcj5n\" (UniqueName: \"kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.459307 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.459249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.560635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.560541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcj5n\" (UniqueName: \"kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.560635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.560599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.560635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.560633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.561018 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.561000    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.561018 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.561012    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.570208 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.570179    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcj5n\" (UniqueName: \"kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.607270 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.607230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:23.744582 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.744557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"]
Jul 06 19:38:23.749408 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:38:23.749366    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecd572f_73c2_4a8d_8453_f44baf7ab802.slice/crio-9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a WatchSource:0}: Error finding container 9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a: Status 404 returned error can't find the container with id 9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a
Jul 06 19:38:23.751698 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:23.751676    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:38:24.266706 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:24.266670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerStarted","Data":"9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a"}
Jul 06 19:38:31.298219 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:31.298187    2578 generic.go:356] "Generic (PLEG): container finished" podID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerID="4772768549c91f3358d6f33a9bcdc376907f3de7eb8a57b521f89bbb8c7c590f" exitCode=0
Jul 06 19:38:31.298615 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:31.298276    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerDied","Data":"4772768549c91f3358d6f33a9bcdc376907f3de7eb8a57b521f89bbb8c7c590f"}
Jul 06 19:38:33.314822 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:33.314785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerStarted","Data":"b5cad5de75afb9d647aa9e5419ea4ed600353e5dd5e0827496aa58c7c4ffb92b"}
Jul 06 19:38:34.319877 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:34.319843    2578 generic.go:356] "Generic (PLEG): container finished" podID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerID="b5cad5de75afb9d647aa9e5419ea4ed600353e5dd5e0827496aa58c7c4ffb92b" exitCode=0
Jul 06 19:38:34.320280 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:34.319937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerDied","Data":"b5cad5de75afb9d647aa9e5419ea4ed600353e5dd5e0827496aa58c7c4ffb92b"}
Jul 06 19:38:43.366287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:43.366196    2578 generic.go:356] "Generic (PLEG): container finished" podID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerID="d2ccc9b3d3343713d1aa8b9c8abc75ec3fde572fdaeb79fe2e8d816cc0abdaf5" exitCode=0
Jul 06 19:38:43.366287 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:43.366267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerDied","Data":"d2ccc9b3d3343713d1aa8b9c8abc75ec3fde572fdaeb79fe2e8d816cc0abdaf5"}
Jul 06 19:38:44.498608 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.498584    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:44.538975 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.538946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcj5n\" (UniqueName: \"kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n\") pod \"aecd572f-73c2-4a8d-8453-f44baf7ab802\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") "
Jul 06 19:38:44.539138 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.538994    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util\") pod \"aecd572f-73c2-4a8d-8453-f44baf7ab802\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") "
Jul 06 19:38:44.539138 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.539044    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle\") pod \"aecd572f-73c2-4a8d-8453-f44baf7ab802\" (UID: \"aecd572f-73c2-4a8d-8453-f44baf7ab802\") "
Jul 06 19:38:44.539738 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.539710    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle" (OuterVolumeSpecName: "bundle") pod "aecd572f-73c2-4a8d-8453-f44baf7ab802" (UID: "aecd572f-73c2-4a8d-8453-f44baf7ab802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:44.541116 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.541091    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n" (OuterVolumeSpecName: "kube-api-access-vcj5n") pod "aecd572f-73c2-4a8d-8453-f44baf7ab802" (UID: "aecd572f-73c2-4a8d-8453-f44baf7ab802"). InnerVolumeSpecName "kube-api-access-vcj5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:44.544309 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.544280    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util" (OuterVolumeSpecName: "util") pod "aecd572f-73c2-4a8d-8453-f44baf7ab802" (UID: "aecd572f-73c2-4a8d-8453-f44baf7ab802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:44.640149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.640069    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:44.640149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.640097    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aecd572f-73c2-4a8d-8453-f44baf7ab802-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:44.640149 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:44.640106    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcj5n\" (UniqueName: \"kubernetes.io/projected/aecd572f-73c2-4a8d-8453-f44baf7ab802-kube-api-access-vcj5n\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:38:45.376965 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:45.376934    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg"
Jul 06 19:38:45.376965 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:45.376944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nrqlg" event={"ID":"aecd572f-73c2-4a8d-8453-f44baf7ab802","Type":"ContainerDied","Data":"9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a"}
Jul 06 19:38:45.377206 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:45.376989    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9945f5117fa96bcc9630dd0b182a6f9f87aba5e6e5f7796dda3dcc09776afb7a"
Jul 06 19:38:51.330430 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330392    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"]
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330714    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="pull"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330726    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="pull"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330739    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="util"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330746    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="util"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330760    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="extract"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330766    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="extract"
Jul 06 19:38:51.330915 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.330815    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aecd572f-73c2-4a8d-8453-f44baf7ab802" containerName="extract"
Jul 06 19:38:51.364346 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.364306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"]
Jul 06 19:38:51.364531 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.364401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.367891 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.367866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:38:51.368186 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.368157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g9zw8\""
Jul 06 19:38:51.368612 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.368597    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 19:38:51.396949 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.396909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt8tj\" (UniqueName: \"kubernetes.io/projected/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-kube-api-access-kt8tj\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.397119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.396993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.497422 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.497387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt8tj\" (UniqueName: \"kubernetes.io/projected/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-kube-api-access-kt8tj\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.497640 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.497452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.497825 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.497804    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.507251 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.507226    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt8tj\" (UniqueName: \"kubernetes.io/projected/ee2927d7-962a-4f9e-bae5-3b17afe4b16f-kube-api-access-kt8tj\") pod \"cert-manager-operator-controller-manager-55c444bf86-7nbxr\" (UID: \"ee2927d7-962a-4f9e-bae5-3b17afe4b16f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.677082 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.677047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g9zw8\""
Jul 06 19:38:51.685170 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.685149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"
Jul 06 19:38:51.841053 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:51.841004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr"]
Jul 06 19:38:51.843608 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:38:51.843581    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2927d7_962a_4f9e_bae5_3b17afe4b16f.slice/crio-ed7599c0a6eb022202c55462e95e2bc0c79df40688493d87bb2692df7065098d WatchSource:0}: Error finding container ed7599c0a6eb022202c55462e95e2bc0c79df40688493d87bb2692df7065098d: Status 404 returned error can't find the container with id ed7599c0a6eb022202c55462e95e2bc0c79df40688493d87bb2692df7065098d
Jul 06 19:38:52.407140 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:52.407099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr" event={"ID":"ee2927d7-962a-4f9e-bae5-3b17afe4b16f","Type":"ContainerStarted","Data":"ed7599c0a6eb022202c55462e95e2bc0c79df40688493d87bb2692df7065098d"}
Jul 06 19:38:54.416987 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:54.416950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr" event={"ID":"ee2927d7-962a-4f9e-bae5-3b17afe4b16f","Type":"ContainerStarted","Data":"dce6391fef904de23e568240f9ec3459289fb93bbf43517240aff742b8f8f0a9"}
Jul 06 19:38:54.446853 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:54.446793    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7nbxr" podStartSLOduration=1.852188674 podStartE2EDuration="3.446774437s" totalImagesPullingTime="1.594585763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:54.445533035 +0000 UTC m=+363.232996077" watchObservedRunningTime="2026-07-06 19:38:54.446774437 +0000 UTC m=+363.234237479"
Jul 06 19:38:55.442156 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.442122    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"]
Jul 06 19:38:55.444888 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.444868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.451114 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.451095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zckv\""
Jul 06 19:38:55.451252 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.451095    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:38:55.451252 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.451171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:38:55.462879 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.462855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"]
Jul 06 19:38:55.465650 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.465623    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ksh4m"]
Jul 06 19:38:55.468095 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.468077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.471223 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.471207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l4ljh\""
Jul 06 19:38:55.471640 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.471623    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:38:55.471723 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.471648    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:38:55.480158 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.480133    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ksh4m"]
Jul 06 19:38:55.535659 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.535624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9zzc\" (UniqueName: \"kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.535827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.535666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.535827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.535689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.535827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.535710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.535827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.535726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr6zp\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-kube-api-access-mr6zp\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.636935 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.636896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9zzc\" (UniqueName: \"kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.636935 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.636950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.637210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.636990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.637210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.637013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.637210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.637031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr6zp\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-kube-api-access-mr6zp\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.637558 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.637533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.637659 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.637592    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.651734 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.651704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9zzc\" (UniqueName: \"kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.652025 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.652008    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.653181 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.653166    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr6zp\" (UniqueName: \"kubernetes.io/projected/edc4f73d-3459-409c-81d0-eba178761556-kube-api-access-mr6zp\") pod \"cert-manager-webhook-6486ffd997-ksh4m\" (UID: \"edc4f73d-3459-409c-81d0-eba178761556\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.754369 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.754335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:38:55.788452 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.788420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:38:55.909726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.909439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"]
Jul 06 19:38:55.912992 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:38:55.912954    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439818c9_cb4c_43b1_8644_130edb2c3133.slice/crio-8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6 WatchSource:0}: Error finding container 8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6: Status 404 returned error can't find the container with id 8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6
Jul 06 19:38:55.943738 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:55.943707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ksh4m"]
Jul 06 19:38:55.947682 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:38:55.947660    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedc4f73d_3459_409c_81d0_eba178761556.slice/crio-3bd9d4ea261ffb83175f5ef5c0fb2b410873c6c8f5d1d5af326e5eb941c15994 WatchSource:0}: Error finding container 3bd9d4ea261ffb83175f5ef5c0fb2b410873c6c8f5d1d5af326e5eb941c15994: Status 404 returned error can't find the container with id 3bd9d4ea261ffb83175f5ef5c0fb2b410873c6c8f5d1d5af326e5eb941c15994
Jul 06 19:38:56.426199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:56.426101    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m" event={"ID":"edc4f73d-3459-409c-81d0-eba178761556","Type":"ContainerStarted","Data":"3bd9d4ea261ffb83175f5ef5c0fb2b410873c6c8f5d1d5af326e5eb941c15994"}
Jul 06 19:38:56.427599 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:56.427571    2578 generic.go:356] "Generic (PLEG): container finished" podID="439818c9-cb4c-43b1-8644-130edb2c3133" containerID="f6a95092690f1fd308f787e62201d6ff9cd5475f399377912b57bef79c8b25ea" exitCode=0
Jul 06 19:38:56.427726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:56.427612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp" event={"ID":"439818c9-cb4c-43b1-8644-130edb2c3133","Type":"ContainerDied","Data":"f6a95092690f1fd308f787e62201d6ff9cd5475f399377912b57bef79c8b25ea"}
Jul 06 19:38:56.427726 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:56.427646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp" event={"ID":"439818c9-cb4c-43b1-8644-130edb2c3133","Type":"ContainerStarted","Data":"8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6"}
Jul 06 19:38:58.860771 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.860734    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"]
Jul 06 19:38:58.863300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.863280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:58.866141 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.866125    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nqlnm\""
Jul 06 19:38:58.875902 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.875879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"]
Jul 06 19:38:58.970515 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.970413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:58.970668 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:58.970558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnpw4\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-kube-api-access-hnpw4\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.071336 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.071305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnpw4\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-kube-api-access-hnpw4\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.071540 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.071359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.083701 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.083672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnpw4\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-kube-api-access-hnpw4\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.084962 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.084930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8e0d26aa-347b-46bf-b620-0c392eaaf89b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9h4ls\" (UID: \"8e0d26aa-347b-46bf-b620-0c392eaaf89b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.172185 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.172146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"
Jul 06 19:38:59.305199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.305168    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls"]
Jul 06 19:38:59.307950 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:38:59.307922    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e0d26aa_347b_46bf_b620_0c392eaaf89b.slice/crio-e0bb05ba18f768ff8a4b07dc008dce006a772cfda6dcbc2ebf7e713bb6aff173 WatchSource:0}: Error finding container e0bb05ba18f768ff8a4b07dc008dce006a772cfda6dcbc2ebf7e713bb6aff173: Status 404 returned error can't find the container with id e0bb05ba18f768ff8a4b07dc008dce006a772cfda6dcbc2ebf7e713bb6aff173
Jul 06 19:38:59.443689 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.443654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls" event={"ID":"8e0d26aa-347b-46bf-b620-0c392eaaf89b","Type":"ContainerStarted","Data":"e0bb05ba18f768ff8a4b07dc008dce006a772cfda6dcbc2ebf7e713bb6aff173"}
Jul 06 19:38:59.445308 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.445282    2578 generic.go:356] "Generic (PLEG): container finished" podID="439818c9-cb4c-43b1-8644-130edb2c3133" containerID="c3a51c7bb75b171f9edbe9f57451364ea6a62e9e11c847da05f68abc4dc6b12b" exitCode=0
Jul 06 19:38:59.445417 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:38:59.445313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp" event={"ID":"439818c9-cb4c-43b1-8644-130edb2c3133","Type":"ContainerDied","Data":"c3a51c7bb75b171f9edbe9f57451364ea6a62e9e11c847da05f68abc4dc6b12b"}
Jul 06 19:39:00.452468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:00.452431    2578 generic.go:356] "Generic (PLEG): container finished" podID="439818c9-cb4c-43b1-8644-130edb2c3133" containerID="b02b47f4447205ac93bfcb901895b278150915a1ba77aa39252750e168c5822c" exitCode=0
Jul 06 19:39:00.452872 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:00.452520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp" event={"ID":"439818c9-cb4c-43b1-8644-130edb2c3133","Type":"ContainerDied","Data":"b02b47f4447205ac93bfcb901895b278150915a1ba77aa39252750e168c5822c"}
Jul 06 19:39:02.282435 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.282409    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:39:02.399297 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.399260    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9zzc\" (UniqueName: \"kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc\") pod \"439818c9-cb4c-43b1-8644-130edb2c3133\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") "
Jul 06 19:39:02.399469 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.399309    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util\") pod \"439818c9-cb4c-43b1-8644-130edb2c3133\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") "
Jul 06 19:39:02.399469 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.399340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle\") pod \"439818c9-cb4c-43b1-8644-130edb2c3133\" (UID: \"439818c9-cb4c-43b1-8644-130edb2c3133\") "
Jul 06 19:39:02.399829 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.399798    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle" (OuterVolumeSpecName: "bundle") pod "439818c9-cb4c-43b1-8644-130edb2c3133" (UID: "439818c9-cb4c-43b1-8644-130edb2c3133"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:02.402581 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.402544    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc" (OuterVolumeSpecName: "kube-api-access-f9zzc") pod "439818c9-cb4c-43b1-8644-130edb2c3133" (UID: "439818c9-cb4c-43b1-8644-130edb2c3133"). InnerVolumeSpecName "kube-api-access-f9zzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:02.404077 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.404051    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util" (OuterVolumeSpecName: "util") pod "439818c9-cb4c-43b1-8644-130edb2c3133" (UID: "439818c9-cb4c-43b1-8644-130edb2c3133"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:02.465278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.465224    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp"
Jul 06 19:39:02.465509 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.465282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f94gxp" event={"ID":"439818c9-cb4c-43b1-8644-130edb2c3133","Type":"ContainerDied","Data":"8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6"}
Jul 06 19:39:02.465509 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.465355    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8154fca7dec8daeeb82b5ab69d4d79bd4a33235a0675ee453cc1cc2d57052ea6"
Jul 06 19:39:02.467932 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.467889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls" event={"ID":"8e0d26aa-347b-46bf-b620-0c392eaaf89b","Type":"ContainerStarted","Data":"8783f96f577c8874d3cd6f348cc888bf6e467fdcc47bbbeb6de72dd2be4edaab"}
Jul 06 19:39:02.487641 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.487590    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9h4ls" podStartSLOduration=1.494859422 podStartE2EDuration="4.487572797s" totalImagesPullingTime="2.992713375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:02.486499533 +0000 UTC m=+371.273962575" watchObservedRunningTime="2026-07-06 19:39:02.487572797 +0000 UTC m=+371.275035838"
Jul 06 19:39:02.500846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.500811    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9zzc\" (UniqueName: \"kubernetes.io/projected/439818c9-cb4c-43b1-8644-130edb2c3133-kube-api-access-f9zzc\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:02.500846 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.500848    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:02.501057 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:02.500861    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/439818c9-cb4c-43b1-8644-130edb2c3133-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:07.937353 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937315    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2wthn"]
Jul 06 19:39:07.937756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937717    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="extract"
Jul 06 19:39:07.937756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937730    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="extract"
Jul 06 19:39:07.937756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937743    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="pull"
Jul 06 19:39:07.937756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937748    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="pull"
Jul 06 19:39:07.937900 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937764    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="util"
Jul 06 19:39:07.937900 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937770    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="util"
Jul 06 19:39:07.937900 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.937832    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="439818c9-cb4c-43b1-8644-130edb2c3133" containerName="extract"
Jul 06 19:39:07.939858 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.939842    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:07.942838 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.942818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xzjws\""
Jul 06 19:39:07.952520 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:07.952498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2wthn"]
Jul 06 19:39:08.048433 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.048393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gxj\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-kube-api-access-b8gxj\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.048596 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.048461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-bound-sa-token\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.149461 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.149422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gxj\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-kube-api-access-b8gxj\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.149643 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.149530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-bound-sa-token\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.160103 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.160084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gxj\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-kube-api-access-b8gxj\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.162224 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.162197    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e5c35c-f3c8-46ef-b331-0897684f8a24-bound-sa-token\") pod \"cert-manager-55b4d954d5-2wthn\" (UID: \"e7e5c35c-f3c8-46ef-b331-0897684f8a24\") " pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.249350 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.249322    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2wthn"
Jul 06 19:39:08.406168 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.406138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2wthn"]
Jul 06 19:39:08.407643 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:39:08.407614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e5c35c_f3c8_46ef_b331_0897684f8a24.slice/crio-bd56f0b18e68e9c483b069fcd30cb3ef8391eebaa5c169693d135a015771a1f5 WatchSource:0}: Error finding container bd56f0b18e68e9c483b069fcd30cb3ef8391eebaa5c169693d135a015771a1f5: Status 404 returned error can't find the container with id bd56f0b18e68e9c483b069fcd30cb3ef8391eebaa5c169693d135a015771a1f5
Jul 06 19:39:08.496210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.496169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2wthn" event={"ID":"e7e5c35c-f3c8-46ef-b331-0897684f8a24","Type":"ContainerStarted","Data":"327390deeb3b5f1b123e31afb7d97fe9659c77fd6ffa07571a0aa49d6b1f7f0a"}
Jul 06 19:39:08.496210 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.496222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2wthn" event={"ID":"e7e5c35c-f3c8-46ef-b331-0897684f8a24","Type":"ContainerStarted","Data":"bd56f0b18e68e9c483b069fcd30cb3ef8391eebaa5c169693d135a015771a1f5"}
Jul 06 19:39:08.528431 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:08.528314    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2wthn" podStartSLOduration=1.528296877 podStartE2EDuration="1.528296877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:08.525788006 +0000 UTC m=+377.313251048" watchObservedRunningTime="2026-07-06 19:39:08.528296877 +0000 UTC m=+377.315759919"
Jul 06 19:39:12.516000 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:12.515959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m" event={"ID":"edc4f73d-3459-409c-81d0-eba178761556","Type":"ContainerStarted","Data":"d154dd7c8a4f2f90434d7da991b18e5e6aa97ef1584b52a3e445a7819e8e9e40"}
Jul 06 19:39:12.516418 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:12.516014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:39:12.534404 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:12.534351    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m" podStartSLOduration=1.969302329 podStartE2EDuration="17.534336544s" totalImagesPullingTime="15.565034215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:12.533923158 +0000 UTC m=+381.321386200" watchObservedRunningTime="2026-07-06 19:39:12.534336544 +0000 UTC m=+381.321799587"
Jul 06 19:39:17.723144 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.723107    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"]
Jul 06 19:39:17.726623 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.726605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.729398 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.729375    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:39:17.730409 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.730390    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6zckv\""
Jul 06 19:39:17.730529 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.730453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:39:17.737198 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.737172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"]
Jul 06 19:39:17.833781 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.833742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.837507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.833786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.837507 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.834305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zsg\" (UniqueName: \"kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.935954 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.935912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.935954 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.935955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.936243 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.936031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zsg\" (UniqueName: \"kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.936395 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.936368    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.936497 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.936381    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:17.947214 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:17.947182    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zsg\" (UniqueName: \"kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:18.036799 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.036751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:18.174387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.174361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"]
Jul 06 19:39:18.177281 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:39:18.177243    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7105ba_d296_4beb_bf1a_d16b676ad56d.slice/crio-bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38 WatchSource:0}: Error finding container bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38: Status 404 returned error can't find the container with id bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38
Jul 06 19:39:18.523389 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.523353    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ksh4m"
Jul 06 19:39:18.546060 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.546031    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerID="e0d30f534e080cb34397fda762e0a388130e1481bdbece87953aac5e1acd435f" exitCode=0
Jul 06 19:39:18.546200 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.546120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85" event={"ID":"ff7105ba-d296-4beb-bf1a-d16b676ad56d","Type":"ContainerDied","Data":"e0d30f534e080cb34397fda762e0a388130e1481bdbece87953aac5e1acd435f"}
Jul 06 19:39:18.546200 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:18.546176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85" event={"ID":"ff7105ba-d296-4beb-bf1a-d16b676ad56d","Type":"ContainerStarted","Data":"bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38"}
Jul 06 19:39:19.552379 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:19.552341    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerID="863ea97aaa87e7821e9819535b1384164517c712e81ccfa8f08e2b1bae16cf3a" exitCode=0
Jul 06 19:39:19.552759 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:19.552395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85" event={"ID":"ff7105ba-d296-4beb-bf1a-d16b676ad56d","Type":"ContainerDied","Data":"863ea97aaa87e7821e9819535b1384164517c712e81ccfa8f08e2b1bae16cf3a"}
Jul 06 19:39:20.559460 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:20.559425    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerID="9b61377005e5f0ace5fd65e23a0d2fd9da6e6aa03d7e65e3a8c9b8f3e913cd7b" exitCode=0
Jul 06 19:39:20.559886 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:20.559513    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85" event={"ID":"ff7105ba-d296-4beb-bf1a-d16b676ad56d","Type":"ContainerDied","Data":"9b61377005e5f0ace5fd65e23a0d2fd9da6e6aa03d7e65e3a8c9b8f3e913cd7b"}
Jul 06 19:39:21.700066 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.700038    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:21.869229 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.869133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util\") pod \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") "
Jul 06 19:39:21.869229 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.869190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle\") pod \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") "
Jul 06 19:39:21.869229 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.869207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4zsg\" (UniqueName: \"kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg\") pod \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\" (UID: \"ff7105ba-d296-4beb-bf1a-d16b676ad56d\") "
Jul 06 19:39:21.869954 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.869929    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle" (OuterVolumeSpecName: "bundle") pod "ff7105ba-d296-4beb-bf1a-d16b676ad56d" (UID: "ff7105ba-d296-4beb-bf1a-d16b676ad56d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:21.871316 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.871295    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg" (OuterVolumeSpecName: "kube-api-access-k4zsg") pod "ff7105ba-d296-4beb-bf1a-d16b676ad56d" (UID: "ff7105ba-d296-4beb-bf1a-d16b676ad56d"). InnerVolumeSpecName "kube-api-access-k4zsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:39:21.877669 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.877636    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util" (OuterVolumeSpecName: "util") pod "ff7105ba-d296-4beb-bf1a-d16b676ad56d" (UID: "ff7105ba-d296-4beb-bf1a-d16b676ad56d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:39:21.970584 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.970544    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:21.970584 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.970575    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4zsg\" (UniqueName: \"kubernetes.io/projected/ff7105ba-d296-4beb-bf1a-d16b676ad56d-kube-api-access-k4zsg\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:21.970584 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:21.970585    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff7105ba-d296-4beb-bf1a-d16b676ad56d-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:39:22.570742 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:22.570706    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85"
Jul 06 19:39:22.570742 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:22.570735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxbz85" event={"ID":"ff7105ba-d296-4beb-bf1a-d16b676ad56d","Type":"ContainerDied","Data":"bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38"}
Jul 06 19:39:22.571031 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:22.570781    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbf5d0611e1a3dbad6aeff6fb34ad80048e39db236893659dbf41dd750ea2a38"
Jul 06 19:39:32.197292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197257    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"]
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197589    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="util"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197601    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="util"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197614    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="extract"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197620    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="extract"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="pull"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197633    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="pull"
Jul 06 19:39:32.197697 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.197694    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7105ba-d296-4beb-bf1a-d16b676ad56d" containerName="extract"
Jul 06 19:39:32.205096 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.205075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.207868 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.207844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:39:32.208088 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.208069    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jxxt7\""
Jul 06 19:39:32.208271 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.208257    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:39:32.208401 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.208384    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:39:32.208451 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.208419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:39:32.224217 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.224183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"]
Jul 06 19:39:32.254223 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.254194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.254390 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.254230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.254390 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.254248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.254523 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.254381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjlzs\" (UniqueName: \"kubernetes.io/projected/1803646b-e9d5-4974-a97e-97da39dde6f4-kube-api-access-mjlzs\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.254523 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.254420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355263 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjlzs\" (UniqueName: \"kubernetes.io/projected/1803646b-e9d5-4974-a97e-97da39dde6f4-kube-api-access-mjlzs\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.355752 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.355727    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-manifests\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.357723 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.357691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1803646b-e9d5-4974-a97e-97da39dde6f4-tmp\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.357894 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.357874    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.357954 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.357914    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1803646b-e9d5-4974-a97e-97da39dde6f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.371363 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.371340    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjlzs\" (UniqueName: \"kubernetes.io/projected/1803646b-e9d5-4974-a97e-97da39dde6f4-kube-api-access-mjlzs\") pod \"opendatahub-operator-controller-manager-f6756874-6cbcl\" (UID: \"1803646b-e9d5-4974-a97e-97da39dde6f4\") " pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.516238 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.516190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:32.660150 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:32.660128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"]
Jul 06 19:39:32.662430 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:39:32.662405    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1803646b_e9d5_4974_a97e_97da39dde6f4.slice/crio-0f2309810e5cfd676de68ad9ec5701b10e90524ca6af8993e1e9de29200d72da WatchSource:0}: Error finding container 0f2309810e5cfd676de68ad9ec5701b10e90524ca6af8993e1e9de29200d72da: Status 404 returned error can't find the container with id 0f2309810e5cfd676de68ad9ec5701b10e90524ca6af8993e1e9de29200d72da
Jul 06 19:39:33.625340 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:33.625300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl" event={"ID":"1803646b-e9d5-4974-a97e-97da39dde6f4","Type":"ContainerStarted","Data":"0f2309810e5cfd676de68ad9ec5701b10e90524ca6af8993e1e9de29200d72da"}
Jul 06 19:39:35.638109 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:35.638071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl" event={"ID":"1803646b-e9d5-4974-a97e-97da39dde6f4","Type":"ContainerStarted","Data":"9418a05b9a0e4adf45101db8f28e9633d9292525ab0b154acdfd9c43d60f1695"}
Jul 06 19:39:36.644563 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:36.644525    2578 generic.go:356] "Generic (PLEG): container finished" podID="1803646b-e9d5-4974-a97e-97da39dde6f4" containerID="9418a05b9a0e4adf45101db8f28e9633d9292525ab0b154acdfd9c43d60f1695" exitCode=0
Jul 06 19:39:36.644949 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:36.644579    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl" event={"ID":"1803646b-e9d5-4974-a97e-97da39dde6f4","Type":"ContainerDied","Data":"9418a05b9a0e4adf45101db8f28e9633d9292525ab0b154acdfd9c43d60f1695"}
Jul 06 19:39:37.651558 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:37.651522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl" event={"ID":"1803646b-e9d5-4974-a97e-97da39dde6f4","Type":"ContainerStarted","Data":"3fe52040aea29754e41b5039bdb3ca63e97d2a1153c4d54b764a67c502d09630"}
Jul 06 19:39:37.651963 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:37.651681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:37.687180 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:37.687125    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl" podStartSLOduration=1.540016531 podStartE2EDuration="5.687107366s" totalImagesPullingTime="3.127062574s" totalInitContainerRuntime="1.020028261s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:37.685436031 +0000 UTC m=+406.472899069" watchObservedRunningTime="2026-07-06 19:39:37.687107366 +0000 UTC m=+406.474570408"
Jul 06 19:39:48.658224 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:48.658191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f6756874-6cbcl"
Jul 06 19:39:53.023119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.023076    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cgvgb"]
Jul 06 19:39:53.029009 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.028987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.032895 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.032879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:39:53.046016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.045989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cgvgb"]
Jul 06 19:39:53.136169 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.136126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.136373 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.136184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4nv\" (UniqueName: \"kubernetes.io/projected/13448163-cd2d-4961-88b9-4554af0a6cdc-kube-api-access-bh4nv\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.237043 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.236999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4nv\" (UniqueName: \"kubernetes.io/projected/13448163-cd2d-4961-88b9-4554af0a6cdc-kube-api-access-bh4nv\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.237204 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.237113    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.237248 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:39:53.237241    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:39:53.237333 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:39:53.237323    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs podName:13448163-cd2d-4961-88b9-4554af0a6cdc nodeName:}" failed. No retries permitted until 2026-07-06 19:39:53.737291484 +0000 UTC m=+422.524754510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs") pod "model-serving-api-54d89bd5fc-cgvgb" (UID: "13448163-cd2d-4961-88b9-4554af0a6cdc") : secret "model-serving-api-tls" not found
Jul 06 19:39:53.250935 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.250906    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4nv\" (UniqueName: \"kubernetes.io/projected/13448163-cd2d-4961-88b9-4554af0a6cdc-kube-api-access-bh4nv\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.742276 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.742239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.744642 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.744619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13448163-cd2d-4961-88b9-4554af0a6cdc-tls-certs\") pod \"model-serving-api-54d89bd5fc-cgvgb\" (UID: \"13448163-cd2d-4961-88b9-4554af0a6cdc\") " pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:53.939253 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:53.939203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:54.099598 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:54.099571    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cgvgb"]
Jul 06 19:39:54.102518 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:39:54.102463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13448163_cd2d_4961_88b9_4554af0a6cdc.slice/crio-d8fdee8467b9b87b6f266f8da8cc2b777b327109c6c5701452e19589ebcfc508 WatchSource:0}: Error finding container d8fdee8467b9b87b6f266f8da8cc2b777b327109c6c5701452e19589ebcfc508: Status 404 returned error can't find the container with id d8fdee8467b9b87b6f266f8da8cc2b777b327109c6c5701452e19589ebcfc508
Jul 06 19:39:54.735635 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:54.735600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb" event={"ID":"13448163-cd2d-4961-88b9-4554af0a6cdc","Type":"ContainerStarted","Data":"d8fdee8467b9b87b6f266f8da8cc2b777b327109c6c5701452e19589ebcfc508"}
Jul 06 19:39:56.747565 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:56.747533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb" event={"ID":"13448163-cd2d-4961-88b9-4554af0a6cdc","Type":"ContainerStarted","Data":"253ef0cda27805e0418e4018795c428a58163d3f988428e5d0ad25ec04b21a83"}
Jul 06 19:39:56.747974 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:56.747624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:39:56.768762 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:39:56.768710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb" podStartSLOduration=2.909223613 podStartE2EDuration="4.768694654s" totalImagesPullingTime="1.859471041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:56.767217213 +0000 UTC m=+425.554680256" watchObservedRunningTime="2026-07-06 19:39:56.768694654 +0000 UTC m=+425.556157744"
Jul 06 19:40:00.373300 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.373258    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"]
Jul 06 19:40:00.376651 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.376632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.381872 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.381851    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:40:00.382245 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.382219    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:40:00.383100 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.383082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:40:00.383567 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.383444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:40:00.383638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.383563    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lzrb6\""
Jul 06 19:40:00.394945 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.394907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:40:00.396791 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.396768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"]
Jul 06 19:40:00.499745 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.499708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.499920 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.499753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.499920 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.499777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-manager-config\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.499992 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.499908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dp9q\" (UniqueName: \"kubernetes.io/projected/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-kube-api-access-9dp9q\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.600488 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.600439    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-manager-config\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.600657 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.600548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dp9q\" (UniqueName: \"kubernetes.io/projected/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-kube-api-access-9dp9q\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.600657 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.600587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.600657 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.600615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.601203 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.601180    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-manager-config\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.603147 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.603125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.603147 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.603141    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-metrics-cert\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.612489 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.612451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dp9q\" (UniqueName: \"kubernetes.io/projected/dd8fb0da-86e7-42b0-ad22-51eee25abbdd-kube-api-access-9dp9q\") pod \"lws-controller-manager-fdd95bb87-s8pgp\" (UID: \"dd8fb0da-86e7-42b0-ad22-51eee25abbdd\") " pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.686296 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.686206    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:00.822969 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:00.822933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"]
Jul 06 19:40:00.825961 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:40:00.825931    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8fb0da_86e7_42b0_ad22_51eee25abbdd.slice/crio-593d0bae89d40403c80fe0d04d9ead8e7a84103455a9f02891c453b4d66b707e WatchSource:0}: Error finding container 593d0bae89d40403c80fe0d04d9ead8e7a84103455a9f02891c453b4d66b707e: Status 404 returned error can't find the container with id 593d0bae89d40403c80fe0d04d9ead8e7a84103455a9f02891c453b4d66b707e
Jul 06 19:40:01.772407 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:01.772344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp" event={"ID":"dd8fb0da-86e7-42b0-ad22-51eee25abbdd","Type":"ContainerStarted","Data":"593d0bae89d40403c80fe0d04d9ead8e7a84103455a9f02891c453b4d66b707e"}
Jul 06 19:40:02.992995 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:02.992961    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"]
Jul 06 19:40:02.998134 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:02.998108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.002823 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.002800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xtq82\""
Jul 06 19:40:03.002948 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.002812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:40:03.003907 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.003886    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:40:03.004012 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.003893    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:40:03.004069 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.004043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:40:03.037927 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.037891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"]
Jul 06 19:40:03.130503 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.127656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b24d095-d323-4c7a-9243-9a474bddfe8a-tls-certs\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.130503 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.127716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b24d095-d323-4c7a-9243-9a474bddfe8a-tmp\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.130503 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.127786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mlc\" (UniqueName: \"kubernetes.io/projected/7b24d095-d323-4c7a-9243-9a474bddfe8a-kube-api-access-58mlc\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.228894 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.228858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mlc\" (UniqueName: \"kubernetes.io/projected/7b24d095-d323-4c7a-9243-9a474bddfe8a-kube-api-access-58mlc\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.229080 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.228914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b24d095-d323-4c7a-9243-9a474bddfe8a-tls-certs\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.229080 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.228941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b24d095-d323-4c7a-9243-9a474bddfe8a-tmp\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.231716 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.231684    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b24d095-d323-4c7a-9243-9a474bddfe8a-tls-certs\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.232496 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.232445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b24d095-d323-4c7a-9243-9a474bddfe8a-tmp\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.262946 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.262911    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mlc\" (UniqueName: \"kubernetes.io/projected/7b24d095-d323-4c7a-9243-9a474bddfe8a-kube-api-access-58mlc\") pod \"kube-auth-proxy-696fc764fb-9sz8v\" (UID: \"7b24d095-d323-4c7a-9243-9a474bddfe8a\") " pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.309695 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.309660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"
Jul 06 19:40:03.511827 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.511791    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v"]
Jul 06 19:40:03.512526 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:40:03.512490    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b24d095_d323_4c7a_9243_9a474bddfe8a.slice/crio-65d4642f4945c9e16a4943f6df9186f9ed93af81dd68e08e14b3a00f3fb03806 WatchSource:0}: Error finding container 65d4642f4945c9e16a4943f6df9186f9ed93af81dd68e08e14b3a00f3fb03806: Status 404 returned error can't find the container with id 65d4642f4945c9e16a4943f6df9186f9ed93af81dd68e08e14b3a00f3fb03806
Jul 06 19:40:03.786266 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:03.786159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v" event={"ID":"7b24d095-d323-4c7a-9243-9a474bddfe8a","Type":"ContainerStarted","Data":"65d4642f4945c9e16a4943f6df9186f9ed93af81dd68e08e14b3a00f3fb03806"}
Jul 06 19:40:07.757252 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:07.757213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cgvgb"
Jul 06 19:40:07.808051 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:07.808011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v" event={"ID":"7b24d095-d323-4c7a-9243-9a474bddfe8a","Type":"ContainerStarted","Data":"c54bd00a60c6fac4cfc83febda4efa6bff7d6ed3853186b5a05dd05600d11a01"}
Jul 06 19:40:07.852349 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:07.852297    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-696fc764fb-9sz8v" podStartSLOduration=2.6076989040000003 podStartE2EDuration="5.852279074s" totalImagesPullingTime="3.24458017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:07.850717743 +0000 UTC m=+436.638180786" watchObservedRunningTime="2026-07-06 19:40:07.852279074 +0000 UTC m=+436.639742117"
Jul 06 19:40:10.825352 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:10.825314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp" event={"ID":"dd8fb0da-86e7-42b0-ad22-51eee25abbdd","Type":"ContainerStarted","Data":"0a0d3f8d10ec38068aef2c974c0a4c7785b91c8acf300df91490dc19f60a9373"}
Jul 06 19:40:10.825822 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:10.825460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:40:10.871653 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:10.871598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp" podStartSLOduration=1.764188879 podStartE2EDuration="10.871582s" totalImagesPullingTime="9.107393121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:10.868939725 +0000 UTC m=+439.656402767" watchObservedRunningTime="2026-07-06 19:40:10.871582 +0000 UTC m=+439.659045041"
Jul 06 19:40:21.832118 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:40:21.832037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fdd95bb87-s8pgp"
Jul 06 19:41:08.899413 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.899375    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"]
Jul 06 19:41:08.902056 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.902038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:08.906848 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.906825    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:41:08.908113 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.908090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kztpm\""
Jul 06 19:41:08.908220 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.908090    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:41:08.912157 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.912137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:08.912277 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.912189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t82s\" (UniqueName: \"kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:08.912277 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.912241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:08.933999 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:08.933963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"]
Jul 06 19:41:09.013413 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.013386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.013605 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.013449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t82s\" (UniqueName: \"kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.013605 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.013470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.013806 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.013787    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.013871 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.013788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.023640 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.023615    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t82s\" (UniqueName: \"kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.211610 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.211525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:09.345016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.344989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"]
Jul 06 19:41:09.347529 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:41:09.347499    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2f982d_8a86_476d_87ad_16f15427a841.slice/crio-47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346 WatchSource:0}: Error finding container 47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346: Status 404 returned error can't find the container with id 47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346
Jul 06 19:41:09.423711 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.423668    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"]
Jul 06 19:41:09.427213 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.427189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.441614 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.441578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"]
Jul 06 19:41:09.519220 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.519181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.519220 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.519225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.519408 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.519263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxczl\" (UniqueName: \"kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.619817 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.619778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.619981 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.619839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxczl\" (UniqueName: \"kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.619981 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.619940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.620257 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.620234    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.620293 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.620263    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.629949 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.629929    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxczl\" (UniqueName: \"kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.742267 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.742195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:09.841549 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.841515    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"]
Jul 06 19:41:09.845529 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.845504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:09.851943 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.851914    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"]
Jul 06 19:41:09.899687 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.899664    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"]
Jul 06 19:41:09.901810 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:41:09.901784    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f767a6e_75f7_4f5c_9761_fe23f0e97ac5.slice/crio-8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d WatchSource:0}: Error finding container 8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d: Status 404 returned error can't find the container with id 8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d
Jul 06 19:41:09.923316 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.923288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:09.923437 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.923340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv2wb\" (UniqueName: \"kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:09.923520 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:09.923453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.024653 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.024620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.024808 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.024677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.024808 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.024734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv2wb\" (UniqueName: \"kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.024993 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.024976    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.025107 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.025086    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.036123 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.036096    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv2wb\" (UniqueName: \"kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.122162 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.122130    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe2f982d-8a86-476d-87ad-16f15427a841" containerID="3afd62ec70fa1b2f639582d102423b4420cdfefc432b83cb1349afc3ce239419" exitCode=0
Jul 06 19:41:10.122346 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.122225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9" event={"ID":"fe2f982d-8a86-476d-87ad-16f15427a841","Type":"ContainerDied","Data":"3afd62ec70fa1b2f639582d102423b4420cdfefc432b83cb1349afc3ce239419"}
Jul 06 19:41:10.122346 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.122277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9" event={"ID":"fe2f982d-8a86-476d-87ad-16f15427a841","Type":"ContainerStarted","Data":"47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346"}
Jul 06 19:41:10.123708 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.123686    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerID="87cb3c6f95b654002c8d81b72bf74adc107e3fc5ff10f450a6732cebe951dd07" exitCode=0
Jul 06 19:41:10.123806 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.123716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv" event={"ID":"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5","Type":"ContainerDied","Data":"87cb3c6f95b654002c8d81b72bf74adc107e3fc5ff10f450a6732cebe951dd07"}
Jul 06 19:41:10.123806 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.123768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv" event={"ID":"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5","Type":"ContainerStarted","Data":"8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d"}
Jul 06 19:41:10.158336 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.158307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:10.231579 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.231550    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"]
Jul 06 19:41:10.234390 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.234371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.248749 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.248666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"]
Jul 06 19:41:10.301996 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.301935    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"]
Jul 06 19:41:10.306063 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:41:10.306037    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode175272a_2426_47f1_bba3_88d2bb1b9e4f.slice/crio-29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae WatchSource:0}: Error finding container 29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae: Status 404 returned error can't find the container with id 29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae
Jul 06 19:41:10.328273 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.328251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txvg\" (UniqueName: \"kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.328377 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.328289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.328377 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.328310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.429814 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.429782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txvg\" (UniqueName: \"kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.430135 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.429839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.430135 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.429973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.430270 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.430224    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.430384 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.430364    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.441695 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.441675    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txvg\" (UniqueName: \"kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.545453 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.545205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:10.879547 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:10.879516    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"]
Jul 06 19:41:10.940395 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:41:10.940359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0049be76_8a6c_4ace_a108_ecc707ddf79e.slice/crio-d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327 WatchSource:0}: Error finding container d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327: Status 404 returned error can't find the container with id d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327
Jul 06 19:41:11.130323 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.130290    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerID="11f2246ec7f1e181313557a8cf5b6caac53a672d948daae4e8e3f3cec7ac1817" exitCode=0
Jul 06 19:41:11.130497 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.130379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv" event={"ID":"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5","Type":"ContainerDied","Data":"11f2246ec7f1e181313557a8cf5b6caac53a672d948daae4e8e3f3cec7ac1817"}
Jul 06 19:41:11.131935 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.131848    2578 generic.go:356] "Generic (PLEG): container finished" podID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerID="471f2e0be3f5253cda535069795674cc94c79035ccff6aa13a81e2a7bed37bde" exitCode=0
Jul 06 19:41:11.131935 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.131924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs" event={"ID":"e175272a-2426-47f1-bba3-88d2bb1b9e4f","Type":"ContainerDied","Data":"471f2e0be3f5253cda535069795674cc94c79035ccff6aa13a81e2a7bed37bde"}
Jul 06 19:41:11.132049 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.131963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs" event={"ID":"e175272a-2426-47f1-bba3-88d2bb1b9e4f","Type":"ContainerStarted","Data":"29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae"}
Jul 06 19:41:11.133817 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.133789    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe2f982d-8a86-476d-87ad-16f15427a841" containerID="a4b6d302e81dc0c30941c067c6a0b79c590126e860ae2ee5ddc98989ca0209f0" exitCode=0
Jul 06 19:41:11.133922 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.133827    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9" event={"ID":"fe2f982d-8a86-476d-87ad-16f15427a841","Type":"ContainerDied","Data":"a4b6d302e81dc0c30941c067c6a0b79c590126e860ae2ee5ddc98989ca0209f0"}
Jul 06 19:41:11.135572 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.135552    2578 generic.go:356] "Generic (PLEG): container finished" podID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerID="1a8fe4128ef48d2728b2701a916fb51f552ab99090a6d0e1e612154dedb31ab8" exitCode=0
Jul 06 19:41:11.135638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.135586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw" event={"ID":"0049be76-8a6c-4ace-a108-ecc707ddf79e","Type":"ContainerDied","Data":"1a8fe4128ef48d2728b2701a916fb51f552ab99090a6d0e1e612154dedb31ab8"}
Jul 06 19:41:11.135638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:11.135612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw" event={"ID":"0049be76-8a6c-4ace-a108-ecc707ddf79e","Type":"ContainerStarted","Data":"d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327"}
Jul 06 19:41:12.142685 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.142650    2578 generic.go:356] "Generic (PLEG): container finished" podID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerID="8b10c3283c5a98782f7c1800e7c7a7242af95a676880fa13c43947ea3303da48" exitCode=0
Jul 06 19:41:12.143151 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.142728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs" event={"ID":"e175272a-2426-47f1-bba3-88d2bb1b9e4f","Type":"ContainerDied","Data":"8b10c3283c5a98782f7c1800e7c7a7242af95a676880fa13c43947ea3303da48"}
Jul 06 19:41:12.144957 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.144934    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe2f982d-8a86-476d-87ad-16f15427a841" containerID="bb345253510a58fa697fe861b39e514ee26d79ab21e2fd99fc1b317cd47869a1" exitCode=0
Jul 06 19:41:12.145071 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.145034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9" event={"ID":"fe2f982d-8a86-476d-87ad-16f15427a841","Type":"ContainerDied","Data":"bb345253510a58fa697fe861b39e514ee26d79ab21e2fd99fc1b317cd47869a1"}
Jul 06 19:41:12.146673 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.146652    2578 generic.go:356] "Generic (PLEG): container finished" podID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerID="64ed17582199aec718b580b8972c78dca3861daa589cbd7568a7b974d7f111ee" exitCode=0
Jul 06 19:41:12.146792 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.146722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw" event={"ID":"0049be76-8a6c-4ace-a108-ecc707ddf79e","Type":"ContainerDied","Data":"64ed17582199aec718b580b8972c78dca3861daa589cbd7568a7b974d7f111ee"}
Jul 06 19:41:12.148960 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.148938    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerID="6815e9e8b84f6989a2cdce406e655ff0822ac42487645a7a15771e3aff7a5753" exitCode=0
Jul 06 19:41:12.149045 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:12.148971    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv" event={"ID":"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5","Type":"ContainerDied","Data":"6815e9e8b84f6989a2cdce406e655ff0822ac42487645a7a15771e3aff7a5753"}
Jul 06 19:41:13.156911 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.156881    2578 generic.go:356] "Generic (PLEG): container finished" podID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerID="878d1a65887b0a906488567856882b1a3cdb827779777285e42820aa5e80a4e2" exitCode=0
Jul 06 19:41:13.157316 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.156970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs" event={"ID":"e175272a-2426-47f1-bba3-88d2bb1b9e4f","Type":"ContainerDied","Data":"878d1a65887b0a906488567856882b1a3cdb827779777285e42820aa5e80a4e2"}
Jul 06 19:41:13.159088 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.159067    2578 generic.go:356] "Generic (PLEG): container finished" podID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerID="ecbb9592cd8504bc04967ded91dc2d564c52905fb732c3638eb86afe153fd29c" exitCode=0
Jul 06 19:41:13.159178 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.159157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw" event={"ID":"0049be76-8a6c-4ace-a108-ecc707ddf79e","Type":"ContainerDied","Data":"ecbb9592cd8504bc04967ded91dc2d564c52905fb732c3638eb86afe153fd29c"}
Jul 06 19:41:13.327988 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.327961    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:13.330038 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.330022    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:13.356766 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxczl\" (UniqueName: \"kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl\") pod \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") "
Jul 06 19:41:13.356938 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle\") pod \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") "
Jul 06 19:41:13.356938 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t82s\" (UniqueName: \"kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s\") pod \"fe2f982d-8a86-476d-87ad-16f15427a841\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") "
Jul 06 19:41:13.356938 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle\") pod \"fe2f982d-8a86-476d-87ad-16f15427a841\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") "
Jul 06 19:41:13.356938 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util\") pod \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\" (UID: \"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5\") "
Jul 06 19:41:13.357178 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.356940    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util\") pod \"fe2f982d-8a86-476d-87ad-16f15427a841\" (UID: \"fe2f982d-8a86-476d-87ad-16f15427a841\") "
Jul 06 19:41:13.357743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.357581    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle" (OuterVolumeSpecName: "bundle") pod "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" (UID: "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:13.357743 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.357623    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle" (OuterVolumeSpecName: "bundle") pod "fe2f982d-8a86-476d-87ad-16f15427a841" (UID: "fe2f982d-8a86-476d-87ad-16f15427a841"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:13.359533 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.359499    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl" (OuterVolumeSpecName: "kube-api-access-wxczl") pod "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" (UID: "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5"). InnerVolumeSpecName "kube-api-access-wxczl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:13.359836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.359816    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s" (OuterVolumeSpecName: "kube-api-access-8t82s") pod "fe2f982d-8a86-476d-87ad-16f15427a841" (UID: "fe2f982d-8a86-476d-87ad-16f15427a841"). InnerVolumeSpecName "kube-api-access-8t82s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:13.363451 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.363424    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util" (OuterVolumeSpecName: "util") pod "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" (UID: "3f767a6e-75f7-4f5c-9761-fe23f0e97ac5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:13.364415 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.364390    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util" (OuterVolumeSpecName: "util") pod "fe2f982d-8a86-476d-87ad-16f15427a841" (UID: "fe2f982d-8a86-476d-87ad-16f15427a841"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458208    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxczl\" (UniqueName: \"kubernetes.io/projected/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-kube-api-access-wxczl\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458238    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458248    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t82s\" (UniqueName: \"kubernetes.io/projected/fe2f982d-8a86-476d-87ad-16f15427a841-kube-api-access-8t82s\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458257    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458265    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f767a6e-75f7-4f5c-9761-fe23f0e97ac5-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:13.458292 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:13.458272    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe2f982d-8a86-476d-87ad-16f15427a841-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.166146 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.166067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv"
Jul 06 19:41:14.166146 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.166088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv" event={"ID":"3f767a6e-75f7-4f5c-9761-fe23f0e97ac5","Type":"ContainerDied","Data":"8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d"}
Jul 06 19:41:14.166146 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.166137    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8367fc55fad02e614abce30518b9396e6dba7cb2996330c56f86f39e8461d60d"
Jul 06 19:41:14.168068 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.168043    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9"
Jul 06 19:41:14.168068 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.168046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9" event={"ID":"fe2f982d-8a86-476d-87ad-16f15427a841","Type":"ContainerDied","Data":"47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346"}
Jul 06 19:41:14.168237 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.168093    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47b87ef250abca0753b19a096a52c1daf052ce7fbc1eb00e95a0acf0759ff346"
Jul 06 19:41:14.292143 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.292115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:14.336640 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.336615    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:14.366223 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366194    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle\") pod \"0049be76-8a6c-4ace-a108-ecc707ddf79e\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") "
Jul 06 19:41:14.366387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle\") pod \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") "
Jul 06 19:41:14.366387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366294    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv2wb\" (UniqueName: \"kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb\") pod \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") "
Jul 06 19:41:14.366387 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366378    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txvg\" (UniqueName: \"kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg\") pod \"0049be76-8a6c-4ace-a108-ecc707ddf79e\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") "
Jul 06 19:41:14.366556 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util\") pod \"0049be76-8a6c-4ace-a108-ecc707ddf79e\" (UID: \"0049be76-8a6c-4ace-a108-ecc707ddf79e\") "
Jul 06 19:41:14.366556 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.366431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util\") pod \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\" (UID: \"e175272a-2426-47f1-bba3-88d2bb1b9e4f\") "
Jul 06 19:41:14.367185 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.367006    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle" (OuterVolumeSpecName: "bundle") pod "0049be76-8a6c-4ace-a108-ecc707ddf79e" (UID: "0049be76-8a6c-4ace-a108-ecc707ddf79e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:14.367185 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.367048    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle" (OuterVolumeSpecName: "bundle") pod "e175272a-2426-47f1-bba3-88d2bb1b9e4f" (UID: "e175272a-2426-47f1-bba3-88d2bb1b9e4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:14.368737 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.368709    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb" (OuterVolumeSpecName: "kube-api-access-zv2wb") pod "e175272a-2426-47f1-bba3-88d2bb1b9e4f" (UID: "e175272a-2426-47f1-bba3-88d2bb1b9e4f"). InnerVolumeSpecName "kube-api-access-zv2wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:14.369048 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.369023    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg" (OuterVolumeSpecName: "kube-api-access-8txvg") pod "0049be76-8a6c-4ace-a108-ecc707ddf79e" (UID: "0049be76-8a6c-4ace-a108-ecc707ddf79e"). InnerVolumeSpecName "kube-api-access-8txvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:14.372137 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.372113    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util" (OuterVolumeSpecName: "util") pod "0049be76-8a6c-4ace-a108-ecc707ddf79e" (UID: "0049be76-8a6c-4ace-a108-ecc707ddf79e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:14.372563 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.372540    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util" (OuterVolumeSpecName: "util") pod "e175272a-2426-47f1-bba3-88d2bb1b9e4f" (UID: "e175272a-2426-47f1-bba3-88d2bb1b9e4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468085    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txvg\" (UniqueName: \"kubernetes.io/projected/0049be76-8a6c-4ace-a108-ecc707ddf79e-kube-api-access-8txvg\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468117    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468126    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-util\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468133    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0049be76-8a6c-4ace-a108-ecc707ddf79e-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468142    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e175272a-2426-47f1-bba3-88d2bb1b9e4f-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:14.468176 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:14.468150    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv2wb\" (UniqueName: \"kubernetes.io/projected/e175272a-2426-47f1-bba3-88d2bb1b9e4f-kube-api-access-zv2wb\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:41:15.174517 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.174491    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw"
Jul 06 19:41:15.174517 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.174501    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw" event={"ID":"0049be76-8a6c-4ace-a108-ecc707ddf79e","Type":"ContainerDied","Data":"d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327"}
Jul 06 19:41:15.175022 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.174544    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5adebf7131daa9af2f39613d95b3688e3bb8384cebb653fb6dd9eee590e3327"
Jul 06 19:41:15.176431 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.176405    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs" event={"ID":"e175272a-2426-47f1-bba3-88d2bb1b9e4f","Type":"ContainerDied","Data":"29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae"}
Jul 06 19:41:15.176585 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.176438    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29129ad98690f9eb85cd54618de4838a6b02659b065c375973cec8fb028a94ae"
Jul 06 19:41:15.176585 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:15.176440    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs"
Jul 06 19:41:30.083147 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083111    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"]
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083553    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="util"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083572    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="util"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083582    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083590    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083599    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="util"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083607    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="util"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083615    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083620    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083625    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083630    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="pull"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083639    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="extract"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083646    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="extract"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083658    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="extract"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083666    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="extract"
Jul 06 19:41:30.083675 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083689    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083696    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="util"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083701    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="util"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083710    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="pull"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083715    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="pull"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083725    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083730    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083737    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="util"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083742    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="util"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083807    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e175272a-2426-47f1-bba3-88d2bb1b9e4f" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083818    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f767a6e-75f7-4f5c-9761-fe23f0e97ac5" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0049be76-8a6c-4ace-a108-ecc707ddf79e" containerName="extract"
Jul 06 19:41:30.084303 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.083838    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2f982d-8a86-476d-87ad-16f15427a841" containerName="extract"
Jul 06 19:41:30.088672 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.088650    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.097493 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.095827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kztpm\""
Jul 06 19:41:30.097493 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.096033    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 19:41:30.101382 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.097929    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 19:41:30.101382 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.098151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:41:30.102221 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.102197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:41:30.106051 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.106028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"]
Jul 06 19:41:30.211699 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.211661    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.211699 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.211708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44z4\" (UniqueName: \"kubernetes.io/projected/314a000f-035e-42d7-967a-04c59c31fda1-kube-api-access-q44z4\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.211942 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.211791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/314a000f-035e-42d7-967a-04c59c31fda1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.312638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.312551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.312638 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.312593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44z4\" (UniqueName: \"kubernetes.io/projected/314a000f-035e-42d7-967a-04c59c31fda1-kube-api-access-q44z4\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.312818 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.312642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/314a000f-035e-42d7-967a-04c59c31fda1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.312818 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:41:30.312713    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 19:41:30.312818 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:41:30.312798    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert podName:314a000f-035e-42d7-967a-04c59c31fda1 nodeName:}" failed. No retries permitted until 2026-07-06 19:41:30.812777073 +0000 UTC m=+519.600240113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-8cmld" (UID: "314a000f-035e-42d7-967a-04c59c31fda1") : secret "plugin-serving-cert" not found
Jul 06 19:41:30.313280 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.313260    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/314a000f-035e-42d7-967a-04c59c31fda1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.326640 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.326610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44z4\" (UniqueName: \"kubernetes.io/projected/314a000f-035e-42d7-967a-04c59c31fda1-kube-api-access-q44z4\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.818124 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.818087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:30.820381 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:30.820359    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/314a000f-035e-42d7-967a-04c59c31fda1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8cmld\" (UID: \"314a000f-035e-42d7-967a-04c59c31fda1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:31.007342 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:31.007298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"
Jul 06 19:41:31.171042 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:31.171016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld"]
Jul 06 19:41:31.173232 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:41:31.173204    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod314a000f_035e_42d7_967a_04c59c31fda1.slice/crio-1bf95464124bbe5961fa6e5c355161ddb97eaa4e8a5775fe84c45ea64c2d1848 WatchSource:0}: Error finding container 1bf95464124bbe5961fa6e5c355161ddb97eaa4e8a5775fe84c45ea64c2d1848: Status 404 returned error can't find the container with id 1bf95464124bbe5961fa6e5c355161ddb97eaa4e8a5775fe84c45ea64c2d1848
Jul 06 19:41:31.266042 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:31.266005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld" event={"ID":"314a000f-035e-42d7-967a-04c59c31fda1","Type":"ContainerStarted","Data":"1bf95464124bbe5961fa6e5c355161ddb97eaa4e8a5775fe84c45ea64c2d1848"}
Jul 06 19:41:54.409240 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:41:54.409201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld" event={"ID":"314a000f-035e-42d7-967a-04c59c31fda1","Type":"ContainerStarted","Data":"571439f99fddaaf4925c367712ab503e92f61c35410b1c59eba53bacfe24e513"}
Jul 06 19:42:14.889079 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.889009    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8cmld" podStartSLOduration=22.660620282 podStartE2EDuration="44.888987049s" totalImagesPullingTime="22.228366767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:54.454622983 +0000 UTC m=+543.242086025" watchObservedRunningTime="2026-07-06 19:42:14.888987049 +0000 UTC m=+563.676450091"
Jul 06 19:42:14.889587 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.889278    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:42:14.913191 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.913160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:14.917945 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.917920    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:42:14.924002 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.923976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:42:14.986279 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:14.986244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:42:15.017708 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.017677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvst\" (UniqueName: \"kubernetes.io/projected/34e9a5d9-1e2e-414f-9d55-fb32aa729391-kube-api-access-lcvst\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.017871 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.017718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e9a5d9-1e2e-414f-9d55-fb32aa729391-config-file\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.118960 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.118921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvst\" (UniqueName: \"kubernetes.io/projected/34e9a5d9-1e2e-414f-9d55-fb32aa729391-kube-api-access-lcvst\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.119100 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.118966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e9a5d9-1e2e-414f-9d55-fb32aa729391-config-file\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.119653 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.119634    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/34e9a5d9-1e2e-414f-9d55-fb32aa729391-config-file\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.146926 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.146830    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvst\" (UniqueName: \"kubernetes.io/projected/34e9a5d9-1e2e-414f-9d55-fb32aa729391-kube-api-access-lcvst\") pod \"limitador-limitador-54d6d988d5-5797c\" (UID: \"34e9a5d9-1e2e-414f-9d55-fb32aa729391\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.225632 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.225593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:15.418382 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:42:15.418335    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e9a5d9_1e2e_414f_9d55_fb32aa729391.slice/crio-dc5de8e3a30ae3e1bf13c0194d2ff2da4c6554e311b0dbd700b770c6e4b71f86 WatchSource:0}: Error finding container dc5de8e3a30ae3e1bf13c0194d2ff2da4c6554e311b0dbd700b770c6e4b71f86: Status 404 returned error can't find the container with id dc5de8e3a30ae3e1bf13c0194d2ff2da4c6554e311b0dbd700b770c6e4b71f86
Jul 06 19:42:15.419397 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.419359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:42:15.519053 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:15.519009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c" event={"ID":"34e9a5d9-1e2e-414f-9d55-fb32aa729391","Type":"ContainerStarted","Data":"dc5de8e3a30ae3e1bf13c0194d2ff2da4c6554e311b0dbd700b770c6e4b71f86"}
Jul 06 19:42:18.538756 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:18.538715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c" event={"ID":"34e9a5d9-1e2e-414f-9d55-fb32aa729391","Type":"ContainerStarted","Data":"a88c350adf56472216fea5d0751e688c80f48949361934f58f4714b57c7a4a61"}
Jul 06 19:42:18.539247 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:18.538920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:18.595425 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:18.595360    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c" podStartSLOduration=1.895149889 podStartE2EDuration="4.595343244s" totalImagesPullingTime="2.700193355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:18.59366461 +0000 UTC m=+567.381127654" watchObservedRunningTime="2026-07-06 19:42:18.595343244 +0000 UTC m=+567.382806286"
Jul 06 19:42:29.545551 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:29.545517    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5797c"
Jul 06 19:42:49.166364 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.166323    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58dc696b5c-phsfh"]
Jul 06 19:42:49.170008 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.169978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.174236 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.174216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4wlsv\""
Jul 06 19:42:49.191509 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.191468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58dc696b5c-phsfh"]
Jul 06 19:42:49.211984 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.211956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnsr8\" (UniqueName: \"kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8\") pod \"authorino-58dc696b5c-phsfh\" (UID: \"6b4ee61e-5da7-422b-a97a-f628227582fb\") " pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.269587 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.269556    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58dc696b5c-phsfh"]
Jul 06 19:42:49.269844 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:42:49.269824    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gnsr8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58dc696b5c-phsfh" podUID="6b4ee61e-5da7-422b-a97a-f628227582fb"
Jul 06 19:42:49.313179 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.313145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnsr8\" (UniqueName: \"kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8\") pod \"authorino-58dc696b5c-phsfh\" (UID: \"6b4ee61e-5da7-422b-a97a-f628227582fb\") " pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.331164 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.331136    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnsr8\" (UniqueName: \"kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8\") pod \"authorino-58dc696b5c-phsfh\" (UID: \"6b4ee61e-5da7-422b-a97a-f628227582fb\") " pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.708118 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.708083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.715591 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.715560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:49.816158 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.816117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnsr8\" (UniqueName: \"kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8\") pod \"6b4ee61e-5da7-422b-a97a-f628227582fb\" (UID: \"6b4ee61e-5da7-422b-a97a-f628227582fb\") "
Jul 06 19:42:49.818199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.818175    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8" (OuterVolumeSpecName: "kube-api-access-gnsr8") pod "6b4ee61e-5da7-422b-a97a-f628227582fb" (UID: "6b4ee61e-5da7-422b-a97a-f628227582fb"). InnerVolumeSpecName "kube-api-access-gnsr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:42:49.917601 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:49.917560    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnsr8\" (UniqueName: \"kubernetes.io/projected/6b4ee61e-5da7-422b-a97a-f628227582fb-kube-api-access-gnsr8\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:42:50.714797 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:50.714760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58dc696b5c-phsfh"
Jul 06 19:42:50.751570 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:50.751531    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58dc696b5c-phsfh"]
Jul 06 19:42:50.754667 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:50.754639    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58dc696b5c-phsfh"]
Jul 06 19:42:51.839383 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:42:51.839350    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b4ee61e-5da7-422b-a97a-f628227582fb" path="/var/lib/kubelet/pods/6b4ee61e-5da7-422b-a97a-f628227582fb/volumes"
Jul 06 19:43:32.776904 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:43:32.776871    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:43:52.446199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:43:52.446162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:44:12.346044 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:44:12.346009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:44:26.750922 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:44:26.750882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:44:32.952129 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:44:32.952095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:45:10.924047 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:45:10.923959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:45:22.711887 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:45:22.711845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:47:24.814487 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:47:24.814443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:47:34.418309 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:47:34.418266    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:47:45.218712 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:47:45.218628    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:47:54.007142 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:47:54.007098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:48:05.346809 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:48:05.346766    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:48:31.362244 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:48:31.362205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:48:42.012016 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:48:42.011982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:49:24.609164 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:49:24.609081    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:49:34.196966 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:49:34.196926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:49:42.909855 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:49:42.909810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:49:54.331716 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:49:54.331670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:50:05.637056 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:50:05.637021    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:50:17.559928 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:50:17.559886    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:50:28.404695 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:50:28.404652    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:50:37.608416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:50:37.608369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:51:04.010488 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:51:04.010384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:51:13.208629 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:51:13.208589    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:51:39.781416 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:51:39.781382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:51:51.283528 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:51:51.283467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:52:08.047782 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:52:08.047748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:52:17.219870 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:52:17.219783    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:52:27.105394 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:52:27.105353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:52:36.522440 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:52:36.522404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:52:45.816159 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:52:45.816111    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:54:33.327508 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:54:33.327459    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:54:45.096878 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:54:45.096838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:54:53.908232 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:54:53.908198    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:03.494202 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:03.494154    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:13.997899 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:13.997821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:22.201378 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:22.201340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:31.999222 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:31.999183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:43.700621 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:43.700579    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:55:51.999371 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:55:51.999338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:56:02.801946 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:02.801902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:56:38.199199 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:38.199160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:56:39.590064 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.590025    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cb6776745-psfh7"]
Jul 06 19:56:39.593606 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.593587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.631382 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.631338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb6776745-psfh7"]
Jul 06 19:56:39.685581 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-service-ca\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-console-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-oauth-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-oauth-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685767 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-trusted-ca-bundle\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.685960 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.685847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjq62\" (UniqueName: \"kubernetes.io/projected/c963dd55-ff78-42ed-9854-c633761afbe9-kube-api-access-vjq62\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.786879 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.786842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.786879 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.786875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-oauth-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.786893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-trusted-ca-bundle\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.786946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjq62\" (UniqueName: \"kubernetes.io/projected/c963dd55-ff78-42ed-9854-c633761afbe9-kube-api-access-vjq62\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.786996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-service-ca\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.787022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-console-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787122 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.787074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-oauth-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787833 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.787808    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-service-ca\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.787991 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.787968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-oauth-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.788034 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.788015    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-trusted-ca-bundle\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.788073 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.788015    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c963dd55-ff78-42ed-9854-c633761afbe9-console-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.789443 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.789422    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-oauth-config\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.789584 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.789563    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c963dd55-ff78-42ed-9854-c633761afbe9-console-serving-cert\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.801044 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.801011    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjq62\" (UniqueName: \"kubernetes.io/projected/c963dd55-ff78-42ed-9854-c633761afbe9-kube-api-access-vjq62\") pod \"console-cb6776745-psfh7\" (UID: \"c963dd55-ff78-42ed-9854-c633761afbe9\") " pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:39.902652 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:39.902563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:40.048325 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:40.048296    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cb6776745-psfh7"]
Jul 06 19:56:40.050242 ip-10-0-135-8 kubenswrapper[2578]: W0706 19:56:40.050219    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc963dd55_ff78_42ed_9854_c633761afbe9.slice/crio-a67e64c48eeaffede4a17bac371cce01fbd738a337f62eab3591f7acb63ea49a WatchSource:0}: Error finding container a67e64c48eeaffede4a17bac371cce01fbd738a337f62eab3591f7acb63ea49a: Status 404 returned error can't find the container with id a67e64c48eeaffede4a17bac371cce01fbd738a337f62eab3591f7acb63ea49a
Jul 06 19:56:40.065244 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:40.065218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb6776745-psfh7" event={"ID":"c963dd55-ff78-42ed-9854-c633761afbe9","Type":"ContainerStarted","Data":"a67e64c48eeaffede4a17bac371cce01fbd738a337f62eab3591f7acb63ea49a"}
Jul 06 19:56:41.071764 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:41.071724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cb6776745-psfh7" event={"ID":"c963dd55-ff78-42ed-9854-c633761afbe9","Type":"ContainerStarted","Data":"934af47f7431f52280bd6c37c6df0f5fdeb49ee86c53a32fa6b0997720004750"}
Jul 06 19:56:41.092037 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:41.091980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cb6776745-psfh7" podStartSLOduration=2.091967058 podStartE2EDuration="2.091967058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:41.091296171 +0000 UTC m=+1429.878759215" watchObservedRunningTime="2026-07-06 19:56:41.091967058 +0000 UTC m=+1429.879430077"
Jul 06 19:56:47.801989 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:47.801896    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:56:49.902791 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:49.902690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:49.902791 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:49.902782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:49.908492 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:49.908457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:50.121864 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:50.121834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cb6776745-psfh7"
Jul 06 19:56:50.183035 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:50.182947    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:56:58.406233 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:56:58.406197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:57:08.091647 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:08.091603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:57:14.426096 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:14.426062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:57:15.204654 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.204590    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-745746d4d6-2kkwf" podUID="ddd84c4a-00b4-4920-a800-02b600c85cd7" containerName="console" containerID="cri-o://7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298" gracePeriod=15
Jul 06 19:57:15.456335 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.456261    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:57:15.610797 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.610797 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611017 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611017 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611017 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610918    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611017 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.610987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffr5l\" (UniqueName: \"kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config\") pod \"ddd84c4a-00b4-4920-a800-02b600c85cd7\" (UID: \"ddd84c4a-00b4-4920-a800-02b600c85cd7\") "
Jul 06 19:57:15.611294 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611276    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:15.611386 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611346    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config" (OuterVolumeSpecName: "console-config") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:15.611439 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611410    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:15.611603 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611578    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.611677 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611606    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-service-ca\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.611677 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611620    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-trusted-ca-bundle\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.611677 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.611626    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:15.613119 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.613097    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:15.613271 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.613249    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:15.613353 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.613330    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l" (OuterVolumeSpecName: "kube-api-access-ffr5l") pod "ddd84c4a-00b4-4920-a800-02b600c85cd7" (UID: "ddd84c4a-00b4-4920-a800-02b600c85cd7"). InnerVolumeSpecName "kube-api-access-ffr5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:15.712234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.712135    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffr5l\" (UniqueName: \"kubernetes.io/projected/ddd84c4a-00b4-4920-a800-02b600c85cd7-kube-api-access-ffr5l\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.712234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.712178    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-oauth-config\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.712234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.712187    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddd84c4a-00b4-4920-a800-02b600c85cd7-console-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:15.712234 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:15.712198    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddd84c4a-00b4-4920-a800-02b600c85cd7-oauth-serving-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 19:57:16.256653 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.256615    2578 generic.go:356] "Generic (PLEG): container finished" podID="ddd84c4a-00b4-4920-a800-02b600c85cd7" containerID="7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298" exitCode=0
Jul 06 19:57:16.256866 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.256665    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745746d4d6-2kkwf"
Jul 06 19:57:16.256866 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.256697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745746d4d6-2kkwf" event={"ID":"ddd84c4a-00b4-4920-a800-02b600c85cd7","Type":"ContainerDied","Data":"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"}
Jul 06 19:57:16.256866 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.256753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745746d4d6-2kkwf" event={"ID":"ddd84c4a-00b4-4920-a800-02b600c85cd7","Type":"ContainerDied","Data":"8baa31ac3f62457c52b1263ff5c5adbf67862a42b3a3495f5c3898351aedf494"}
Jul 06 19:57:16.256866 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.256777    2578 scope.go:117] "RemoveContainer" containerID="7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"
Jul 06 19:57:16.265858 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.265837    2578 scope.go:117] "RemoveContainer" containerID="7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"
Jul 06 19:57:16.266141 ip-10-0-135-8 kubenswrapper[2578]: E0706 19:57:16.266121    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298\": container with ID starting with 7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298 not found: ID does not exist" containerID="7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"
Jul 06 19:57:16.266201 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.266149    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298"} err="failed to get container status \"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298\": rpc error: code = NotFound desc = could not find container \"7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298\": container with ID starting with 7398514903aa250e9627dc7deaa88329db6c80225879f6c68694623dfe7ec298 not found: ID does not exist"
Jul 06 19:57:16.284524 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.284470    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:57:16.290925 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:16.290895    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745746d4d6-2kkwf"]
Jul 06 19:57:17.839547 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:17.839507    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd84c4a-00b4-4920-a800-02b600c85cd7" path="/var/lib/kubelet/pods/ddd84c4a-00b4-4920-a800-02b600c85cd7/volumes"
Jul 06 19:57:29.221301 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:29.221263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:57:44.216218 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:44.216181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:57:52.226014 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:57:52.225919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:05.913874 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:05.913835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:15.006824 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:15.006734    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:28.228460 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:28.228422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:37.499589 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:37.499555    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:46.913278 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:46.913236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:58:59.206932 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:58:59.206892    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:59:11.403468 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:59:11.403429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:59:20.501623 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:59:20.501588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:59:31.794865 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:59:31.794832    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:59:43.501121 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:59:43.501038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 19:59:53.098836 ip-10-0-135-8 kubenswrapper[2578]: I0706 19:59:53.098802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:00:00.154164 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.154129    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-rs44m"]
Jul 06 20:00:00.154629 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.154579    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd84c4a-00b4-4920-a800-02b600c85cd7" containerName="console"
Jul 06 20:00:00.154629 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.154597    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd84c4a-00b4-4920-a800-02b600c85cd7" containerName="console"
Jul 06 20:00:00.154727 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.154712    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd84c4a-00b4-4920-a800-02b600c85cd7" containerName="console"
Jul 06 20:00:00.157704 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.157688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:00.161052 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.161021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cmcxr\""
Jul 06 20:00:00.180608 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.180573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwwgj\" (UniqueName: \"kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj\") pod \"maas-api-key-cleanup-29722800-rs44m\" (UID: \"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f\") " pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:00.183431 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.183398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-rs44m"]
Jul 06 20:00:00.281871 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.281828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwwgj\" (UniqueName: \"kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj\") pod \"maas-api-key-cleanup-29722800-rs44m\" (UID: \"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f\") " pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:00.294060 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.294031    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwwgj\" (UniqueName: \"kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj\") pod \"maas-api-key-cleanup-29722800-rs44m\" (UID: \"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f\") " pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:00.468059 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.467955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:00.605814 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.605788    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-rs44m"]
Jul 06 20:00:00.607544 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:00:00.607516    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e24b25_c0f4_4b2e_9c52_d34c5d23255f.slice/crio-1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88 WatchSource:0}: Error finding container 1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88: Status 404 returned error can't find the container with id 1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88
Jul 06 20:00:00.609551 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:00.609531    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:00:01.127118 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:01.127075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m" event={"ID":"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f","Type":"ContainerStarted","Data":"1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88"}
Jul 06 20:00:05.912732 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:05.912703    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:00:07.160593 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:07.160492    2578 generic.go:356] "Generic (PLEG): container finished" podID="e3e24b25-c0f4-4b2e-9c52-d34c5d23255f" containerID="2a59aeaf22cc69985d46ce336163631ede2c21d77ca8a25ff09b26fb3dc1339c" exitCode=0
Jul 06 20:00:07.160593 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:07.160564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m" event={"ID":"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f","Type":"ContainerDied","Data":"2a59aeaf22cc69985d46ce336163631ede2c21d77ca8a25ff09b26fb3dc1339c"}
Jul 06 20:00:08.305278 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:08.305253    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:08.359227 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:08.359190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwwgj\" (UniqueName: \"kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj\") pod \"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f\" (UID: \"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f\") "
Jul 06 20:00:08.361341 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:08.361318    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj" (OuterVolumeSpecName: "kube-api-access-nwwgj") pod "e3e24b25-c0f4-4b2e-9c52-d34c5d23255f" (UID: "e3e24b25-c0f4-4b2e-9c52-d34c5d23255f"). InnerVolumeSpecName "kube-api-access-nwwgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:08.460075 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:08.459973    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwwgj\" (UniqueName: \"kubernetes.io/projected/e3e24b25-c0f4-4b2e-9c52-d34c5d23255f-kube-api-access-nwwgj\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:00:09.173169 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:09.173140    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m"
Jul 06 20:00:09.173340 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:09.173137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-rs44m" event={"ID":"e3e24b25-c0f4-4b2e-9c52-d34c5d23255f","Type":"ContainerDied","Data":"1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88"}
Jul 06 20:00:09.173340 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:09.173263    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bb28cf6063b8cf491458d3b4a7fa0e1d4915d5cf96f9e6cc597b4f26d291a88"
Jul 06 20:00:15.003270 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:15.003221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:00:25.028823 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:25.028786    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:00:46.704617 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:46.704578    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:00:56.134215 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:00:56.134179    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:01:07.594550 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:01:07.594512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:01:15.893804 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:01:15.893763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:01:27.008911 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:01:27.008874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:02:47.312562 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:02:47.312456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:02:56.405337 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:02:56.405300    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:03:07.566854 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:07.566815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:03:21.401115 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:21.401073    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:03:49.314210 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:49.314173    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:03:59.253803 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.253767    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:03:59.254236 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.254163    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e24b25-c0f4-4b2e-9c52-d34c5d23255f" containerName="cleanup"
Jul 06 20:03:59.254236 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.254175    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e24b25-c0f4-4b2e-9c52-d34c5d23255f" containerName="cleanup"
Jul 06 20:03:59.254324 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.254243    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e24b25-c0f4-4b2e-9c52-d34c5d23255f" containerName="cleanup"
Jul 06 20:03:59.257006 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.256988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.261074 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.261040    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-84fa8f39\"/\"default-dockercfg-hwvjx\""
Jul 06 20:03:59.261204 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.261094    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-84fa8f39\"/\"openshift-service-ca.crt\""
Jul 06 20:03:59.261204 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.261144    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-84fa8f39\"/\"kube-root-ca.crt\""
Jul 06 20:03:59.261204 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.261152    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-84fa8f39\"/\"e2e-lifecycle-model-84fa8f39-kserve-self-signed-certs\""
Jul 06 20:03:59.389703 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.389874 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.389874 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.389874 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.390006 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.390006 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.389987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzf5k\" (UniqueName: \"kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491160 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491160 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491372 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491372 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzf5k\" (UniqueName: \"kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491372 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491372 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491624 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491678 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491623    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.491831 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.491816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.493546 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.493524    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.493844 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.493826    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.501529 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.501507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzf5k\" (UniqueName: \"kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k\") pod \"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") " pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:03:59.565938 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:03:59.565836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:03.889905 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:03.889866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:04:09.270793 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:04:09.270729    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f34a7107-3752-474e-9fd2-9878768a8c50\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:59Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:59Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:59Z\\\",\\\"message\\\":\\\"containers with unready status: [main]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T20:03:59Z\\\",\\\"message\\\":\\\"containers with unready status: [main]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"main\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/home\\\",\\\"name\\\":\\\"home\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/dev/shm\\\",\\\"name\\\":\\\"dshm\\\"},{\\\"mountPath\\\":\\\"/models\\\",\\\"name\\\":\\\"model-cache\\\"},{\\\"mountPath\\\":\\\"/var/run/kserve/tls\\\",\\\"name\\\":\\\"tls-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nzf5k\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.135.8\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.135.8\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-06T20:03:59Z\\\"}}\" for pod \"ai-tenant-e2e-mt-84fa8f39\"/\"e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-11455d6b-7677-49a5-b9af-ab382c018f61.svc:9743/pod?timeout=10s\": context deadline exceeded" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:10.584705 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:10.584619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:04:10.740876 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:10.740851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:04:10.742101 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:04:10.742070    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf34a7107_3752_474e_9fd2_9878768a8c50.slice/crio-64c3456e1a56ae284ff7234fbe152cf02b6f842ab6da5ad825095c17db71ac2e WatchSource:0}: Error finding container 64c3456e1a56ae284ff7234fbe152cf02b6f842ab6da5ad825095c17db71ac2e: Status 404 returned error can't find the container with id 64c3456e1a56ae284ff7234fbe152cf02b6f842ab6da5ad825095c17db71ac2e
Jul 06 20:04:11.467715 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:11.467671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" event={"ID":"f34a7107-3752-474e-9fd2-9878768a8c50","Type":"ContainerStarted","Data":"64c3456e1a56ae284ff7234fbe152cf02b6f842ab6da5ad825095c17db71ac2e"}
Jul 06 20:04:12.476025 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:12.475983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" event={"ID":"f34a7107-3752-474e-9fd2-9878768a8c50","Type":"ContainerStarted","Data":"ba98c37b86a873c71de3d85a88c6266f23d25738dab9a073fedf48f263735854"}
Jul 06 20:04:12.497771 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:12.497687    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" podStartSLOduration=12.4391817 podStartE2EDuration="13.497666588s" totalImagesPullingTime="1.058484888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:04:12.495267651 +0000 UTC m=+1881.282730693" watchObservedRunningTime="2026-07-06 20:04:12.497666588 +0000 UTC m=+1881.285129631"
Jul 06 20:04:19.566589 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:19.566493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:19.566589 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:19.566542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:19.579104 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:19.579076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:20.529944 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:20.529904    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:04:33.998546 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:33.998504    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:04:47.494391 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:47.494351    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:04:47.528072 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:04:47.528039    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:05:02.548783 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.548729    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" podUID="f34a7107-3752-474e-9fd2-9878768a8c50" containerName="main" containerID="cri-o://ba98c37b86a873c71de3d85a88c6266f23d25738dab9a073fedf48f263735854" gracePeriod=45
Jul 06 20:05:02.752898 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.752866    2578 generic.go:356] "Generic (PLEG): container finished" podID="f34a7107-3752-474e-9fd2-9878768a8c50" containerID="ba98c37b86a873c71de3d85a88c6266f23d25738dab9a073fedf48f263735854" exitCode=0
Jul 06 20:05:02.753058 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.752906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" event={"ID":"f34a7107-3752-474e-9fd2-9878768a8c50","Type":"ContainerDied","Data":"ba98c37b86a873c71de3d85a88c6266f23d25738dab9a073fedf48f263735854"}
Jul 06 20:05:02.801067 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.801008    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:05:02.868545 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868515    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.868545 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868549    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.868808 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.868808 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868627    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzf5k\" (UniqueName: \"kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.868808 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.868808 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm\") pod \"f34a7107-3752-474e-9fd2-9878768a8c50\" (UID: \"f34a7107-3752-474e-9fd2-9878768a8c50\") "
Jul 06 20:05:02.869016 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868835    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home" (OuterVolumeSpecName: "home") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:02.869016 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868848    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache" (OuterVolumeSpecName: "model-cache") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:02.869016 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.868890    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:02.869179 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.869055    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-home\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:02.869179 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.869072    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-model-cache\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:02.869179 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.869087    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-tmp-dir\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:02.870939 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.870907    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:05:02.871061 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.870966    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm" (OuterVolumeSpecName: "dshm") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:05:02.871061 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.870970    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k" (OuterVolumeSpecName: "kube-api-access-nzf5k") pod "f34a7107-3752-474e-9fd2-9878768a8c50" (UID: "f34a7107-3752-474e-9fd2-9878768a8c50"). InnerVolumeSpecName "kube-api-access-nzf5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:05:02.969642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.969602    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f34a7107-3752-474e-9fd2-9878768a8c50-tls-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:02.969642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.969635    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f34a7107-3752-474e-9fd2-9878768a8c50-dshm\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:02.969642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:02.969645    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzf5k\" (UniqueName: \"kubernetes.io/projected/f34a7107-3752-474e-9fd2-9878768a8c50-kube-api-access-nzf5k\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:05:03.759228 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.759196    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"
Jul 06 20:05:03.759746 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.759195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl" event={"ID":"f34a7107-3752-474e-9fd2-9878768a8c50","Type":"ContainerDied","Data":"64c3456e1a56ae284ff7234fbe152cf02b6f842ab6da5ad825095c17db71ac2e"}
Jul 06 20:05:03.759746 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.759322    2578 scope.go:117] "RemoveContainer" containerID="ba98c37b86a873c71de3d85a88c6266f23d25738dab9a073fedf48f263735854"
Jul 06 20:05:03.784767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.784734    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:05:03.790502 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.790457    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-84fa8f39/e2e-lifecycle-model-84fa8f39-kserve-c54ddf675-jfcbl"]
Jul 06 20:05:03.840140 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:03.840108    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34a7107-3752-474e-9fd2-9878768a8c50" path="/var/lib/kubelet/pods/f34a7107-3752-474e-9fd2-9878768a8c50/volumes"
Jul 06 20:05:26.903023 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:26.902986    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:05:40.912239 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:40.912203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:05:53.211606 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:05:53.211574    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:06:41.325822 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.325789    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:06:41.326340 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.326169    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34a7107-3752-474e-9fd2-9878768a8c50" containerName="main"
Jul 06 20:06:41.326340 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.326181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34a7107-3752-474e-9fd2-9878768a8c50" containerName="main"
Jul 06 20:06:41.326340 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.326248    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34a7107-3752-474e-9fd2-9878768a8c50" containerName="main"
Jul 06 20:06:41.329281 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.329261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.333492 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.330719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kvhm\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.334091 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.333861    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 20:06:41.334091 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.333983    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f78f77-openshift-default-dockercfg-ft26w\""
Jul 06 20:06:41.350613 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.350585    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:06:41.431566 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.431767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.431767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.431767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.431767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.431767 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432030 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432030 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432030 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.431839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kvhm\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432184 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.432050    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432184 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.432151    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432276 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.432237    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432319 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.432280    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.432428 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.432411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.433984 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.433957    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.434574 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.434555    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.441239 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.441209    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.441391 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.441368    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kvhm\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm\") pod \"e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") " pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.645012 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.644905    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:41.789238 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.789208    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:06:41.791137 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:06:41.791107    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03bfbc7_4740_40b1_977c_198b58f74d7a.slice/crio-7a73cdd2506516bdc6b147aedeaf711461839be05c022cc0f149e9d2423a69a9 WatchSource:0}: Error finding container 7a73cdd2506516bdc6b147aedeaf711461839be05c022cc0f149e9d2423a69a9: Status 404 returned error can't find the container with id 7a73cdd2506516bdc6b147aedeaf711461839be05c022cc0f149e9d2423a69a9
Jul 06 20:06:41.793264 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:41.793245    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:06:42.291846 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:42.291815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerStarted","Data":"7a73cdd2506516bdc6b147aedeaf711461839be05c022cc0f149e9d2423a69a9"}
Jul 06 20:06:44.199376 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:44.199340    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:06:44.623278 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:44.623238    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:06:44.623397 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:44.623324    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:06:44.623397 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:44.623369    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:06:45.310747 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:45.310705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerStarted","Data":"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"}
Jul 06 20:06:45.340334 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:45.340251    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podStartSLOduration=1.510684911 podStartE2EDuration="4.340232206s" totalImagesPullingTime="2.829547295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:45.33931374 +0000 UTC m=+2034.126776781" watchObservedRunningTime="2026-07-06 20:06:45.340232206 +0000 UTC m=+2034.127695249"
Jul 06 20:06:45.646137 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:45.646051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:45.650847 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:45.650822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:46.316940 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:46.316913    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:46.317961 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:46.317939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:06:58.020948 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:06:58.020907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:07:00.394386 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.394350    2578 generic.go:356] "Generic (PLEG): container finished" podID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerID="c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a" exitCode=0
Jul 06 20:07:00.394872 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.394423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerDied","Data":"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"}
Jul 06 20:07:00.394872 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.394842    2578 scope.go:117] "RemoveContainer" containerID="c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"
Jul 06 20:07:00.395979 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.395949    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:07:00.396043 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.396019    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:07:00.396086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:00.396067    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:07:01.317113 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:01.317074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:07:01.403249 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:01.403200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerStarted","Data":"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"}
Jul 06 20:07:01.645348 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:01.645234    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:07:01.646681 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:01.646642    2578 patch_prober.go:28] interesting pod/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:07:01.646797 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:01.646720    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 06 20:07:02.646263 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:02.646223    2578 patch_prober.go:28] interesting pod/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:07:02.646682 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:02.646286    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 06 20:07:03.646306 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:03.646270    2578 patch_prober.go:28] interesting pod/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:07:03.646813 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:03.646324    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 06 20:07:04.645687 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:04.645646    2578 patch_prober.go:28] interesting pod/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 06 20:07:04.645870 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:04.645707    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 06 20:07:05.649537 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:05.649506    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:07:05.650026 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:05.649964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:07:05.650964 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:05.650943    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:07:07.401769 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:07.401733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:07:32.374080 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.373981    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:07:32.377652 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.377635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.382046 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.382025    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f78f77\"/\"kube-root-ca.crt\""
Jul 06 20:07:32.382182 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.382139    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f78f77\"/\"test-model-f78f77-kserve-self-signed-certs\""
Jul 06 20:07:32.382316 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.382298    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f78f77\"/\"openshift-service-ca.crt\""
Jul 06 20:07:32.382384 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.382358    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f78f77\"/\"default-dockercfg-dfmqj\""
Jul 06 20:07:32.401344 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.401316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:07:32.487784 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.487784 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.488015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.488015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.488015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zhw\" (UniqueName: \"kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.488015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.487967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589283 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589283 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589553 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589553 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589553 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zhw\" (UniqueName: \"kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589553 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589801 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589775    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589867 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589825    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.589935 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.589910    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.591646 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.591628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.591822 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.591806    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.600602 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.600575    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zhw\" (UniqueName: \"kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw\") pod \"test-model-f78f77-kserve-768b5f9c9f-52pkp\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") " pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.687236 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.687142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:32.835875 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:32.835848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:07:32.838109 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:07:32.838075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e780275_9fd5_449d_9cb5_3669bc757141.slice/crio-b7dce46577199fbe9b2f5b942de446dcd83962d032c941b3337fb4051da5a2ea WatchSource:0}: Error finding container b7dce46577199fbe9b2f5b942de446dcd83962d032c941b3337fb4051da5a2ea: Status 404 returned error can't find the container with id b7dce46577199fbe9b2f5b942de446dcd83962d032c941b3337fb4051da5a2ea
Jul 06 20:07:33.582769 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:33.582727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" event={"ID":"9e780275-9fd5-449d-9cb5-3669bc757141","Type":"ContainerStarted","Data":"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"}
Jul 06 20:07:33.582769 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:33.582776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" event={"ID":"9e780275-9fd5-449d-9cb5-3669bc757141","Type":"ContainerStarted","Data":"b7dce46577199fbe9b2f5b942de446dcd83962d032c941b3337fb4051da5a2ea"}
Jul 06 20:07:33.605073 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:33.605017    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" podStartSLOduration=1.605001341 podStartE2EDuration="1.605001341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:33.603499431 +0000 UTC m=+2082.390962476" watchObservedRunningTime="2026-07-06 20:07:33.605001341 +0000 UTC m=+2082.392464383"
Jul 06 20:07:37.715559 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:37.715519    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:07:42.687963 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:42.687928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:42.688522 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:42.688214    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:42.700581 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:42.700556    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:43.650617 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:43.650585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:07:51.389024 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:51.388981    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:07:56.003731 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:07:56.003687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:08:06.409304 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.409255    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" podUID="9e780275-9fd5-449d-9cb5-3669bc757141" containerName="main" containerID="cri-o://9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac" gracePeriod=45
Jul 06 20:08:06.662455 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.662390    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:08:06.765688 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.765654    2578 generic.go:356] "Generic (PLEG): container finished" podID="9e780275-9fd5-449d-9cb5-3669bc757141" containerID="9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac" exitCode=0
Jul 06 20:08:06.765862 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.765695    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"
Jul 06 20:08:06.765862 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.765721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" event={"ID":"9e780275-9fd5-449d-9cb5-3669bc757141","Type":"ContainerDied","Data":"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"}
Jul 06 20:08:06.765862 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.765751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp" event={"ID":"9e780275-9fd5-449d-9cb5-3669bc757141","Type":"ContainerDied","Data":"b7dce46577199fbe9b2f5b942de446dcd83962d032c941b3337fb4051da5a2ea"}
Jul 06 20:08:06.765862 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.765768    2578 scope.go:117] "RemoveContainer" containerID="9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"
Jul 06 20:08:06.774663 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.774643    2578 scope.go:117] "RemoveContainer" containerID="9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"
Jul 06 20:08:06.774932 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:08:06.774912    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac\": container with ID starting with 9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac not found: ID does not exist" containerID="9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"
Jul 06 20:08:06.775005 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.774941    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac"} err="failed to get container status \"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac\": rpc error: code = NotFound desc = could not find container \"9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac\": container with ID starting with 9edb85deb5db57054c056bf05d3148609d7dfca3b4e812ce18a1feb473b265ac not found: ID does not exist"
Jul 06 20:08:06.790255 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790347 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790294    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790347 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790421 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790352    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790421 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790383    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790521 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790460    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7zhw\" (UniqueName: \"kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw\") pod \"9e780275-9fd5-449d-9cb5-3669bc757141\" (UID: \"9e780275-9fd5-449d-9cb5-3669bc757141\") "
Jul 06 20:08:06.790521 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790504    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:06.790679 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790632    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home" (OuterVolumeSpecName: "home") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:06.790829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790699    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:06.790829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790803    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-model-cache\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:06.790829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790821    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-home\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:06.790958 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.790832    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-tmp-dir\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:06.792562 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.792533    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm" (OuterVolumeSpecName: "dshm") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:06.792655 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.792604    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw" (OuterVolumeSpecName: "kube-api-access-j7zhw") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "kube-api-access-j7zhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:06.792655 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.792620    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e780275-9fd5-449d-9cb5-3669bc757141" (UID: "9e780275-9fd5-449d-9cb5-3669bc757141"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:06.891900 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.891868    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7zhw\" (UniqueName: \"kubernetes.io/projected/9e780275-9fd5-449d-9cb5-3669bc757141-kube-api-access-j7zhw\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:06.891900 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.891894    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e780275-9fd5-449d-9cb5-3669bc757141-dshm\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:06.891900 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:06.891904    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e780275-9fd5-449d-9cb5-3669bc757141-tls-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:07.092831 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:07.092802    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:08:07.094933 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:07.094911    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f78f77/test-model-f78f77-kserve-768b5f9c9f-52pkp"]
Jul 06 20:08:07.838790 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:07.838758    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e780275-9fd5-449d-9cb5-3669bc757141" path="/var/lib/kubelet/pods/9e780275-9fd5-449d-9cb5-3669bc757141/volumes"
Jul 06 20:08:38.562890 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:38.562855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:08:43.166759 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:43.166671    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:08:43.167225 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:43.166959    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy" containerID="cri-o://932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c" gracePeriod=30
Jul 06 20:08:48.423911 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.423888    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:08:48.441670 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441670 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441868 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441868 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kvhm\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441868 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441868 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441731    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.441868 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.441759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.442132 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442042    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:48.442198 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442142    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:08:48.442305 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442286    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.442365 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442336    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket\") pod \"c03bfbc7-4740-40b1-977c-198b58f74d7a\" (UID: \"c03bfbc7-4740-40b1-977c-198b58f74d7a\") "
Jul 06 20:08:48.442664 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442642    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c03bfbc7-4740-40b1-977c-198b58f74d7a-istiod-ca-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.442761 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442669    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.442761 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442700    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:48.442970 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442949    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:48.443055 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.442982    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:48.444252 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.444223    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:08:48.444252 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.444240    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm" (OuterVolumeSpecName: "kube-api-access-5kvhm") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "kube-api-access-5kvhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:48.444400 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.444337    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:48.444400 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.444360    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c03bfbc7-4740-40b1-977c-198b58f74d7a" (UID: "c03bfbc7-4740-40b1-977c-198b58f74d7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548705    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-envoy\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548758    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kvhm\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-kube-api-access-5kvhm\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548774    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-podinfo\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548794    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-token\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548808    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-workload-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548821    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-credential-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:48.549230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:48.548835    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c03bfbc7-4740-40b1-977c-198b58f74d7a-istio-data\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:08:49.000449 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.000415    2578 generic.go:356] "Generic (PLEG): container finished" podID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerID="932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c" exitCode=0
Jul 06 20:08:49.000638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.000500    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"
Jul 06 20:08:49.000638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.000506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerDied","Data":"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"}
Jul 06 20:08:49.000638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.000566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7" event={"ID":"c03bfbc7-4740-40b1-977c-198b58f74d7a","Type":"ContainerDied","Data":"7a73cdd2506516bdc6b147aedeaf711461839be05c022cc0f149e9d2423a69a9"}
Jul 06 20:08:49.000638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.000596    2578 scope.go:117] "RemoveContainer" containerID="932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"
Jul 06 20:08:49.010986 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.010969    2578 scope.go:117] "RemoveContainer" containerID="c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"
Jul 06 20:08:49.019584 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.019504    2578 scope.go:117] "RemoveContainer" containerID="932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"
Jul 06 20:08:49.019796 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:08:49.019777    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c\": container with ID starting with 932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c not found: ID does not exist" containerID="932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"
Jul 06 20:08:49.019848 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.019805    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c"} err="failed to get container status \"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c\": rpc error: code = NotFound desc = could not find container \"932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c\": container with ID starting with 932397163a83f6395276ff3f2698872acbeee9039a0a2bd244651e58755cd92c not found: ID does not exist"
Jul 06 20:08:49.019848 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.019822    2578 scope.go:117] "RemoveContainer" containerID="c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"
Jul 06 20:08:49.020042 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:08:49.020025    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a\": container with ID starting with c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a not found: ID does not exist" containerID="c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"
Jul 06 20:08:49.020096 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.020053    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a"} err="failed to get container status \"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a\": rpc error: code = NotFound desc = could not find container \"c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a\": container with ID starting with c955606f3d3af1286b1b5347ce48200fc5c2284a968ce72d52584f25f30aaa1a not found: ID does not exist"
Jul 06 20:08:49.024924 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.024902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:08:49.028188 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.028167    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f78f77-openshift-default-667f649757-wqqt7"]
Jul 06 20:08:49.842827 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:49.842793    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" path="/var/lib/kubelet/pods/c03bfbc7-4740-40b1-977c-198b58f74d7a/volumes"
Jul 06 20:08:51.799109 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:51.799074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:08:52.144786 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.144699    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:08:52.145088 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.145142 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145090    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.145142 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145108    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.145142 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.145142 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145125    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e780275-9fd5-449d-9cb5-3669bc757141" containerName="main"
Jul 06 20:08:52.145142 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145130    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e780275-9fd5-449d-9cb5-3669bc757141" containerName="main"
Jul 06 20:08:52.145325 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145191    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.145325 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145200    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e780275-9fd5-449d-9cb5-3669bc757141" containerName="main"
Jul 06 20:08:52.145325 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.145207    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c03bfbc7-4740-40b1-977c-198b58f74d7a" containerName="istio-proxy"
Jul 06 20:08:52.150044 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.150020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.154068 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.154045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 20:08:52.154606 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.154588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-78a644-openshift-default-dockercfg-b7sq6\""
Jul 06 20:08:52.162393 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.162367    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:08:52.183057 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f79g\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183196 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183196 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183274 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183274 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183274 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183375 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183285    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183375 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.183441 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.183389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284348 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284348 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f79g\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.284660 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.284597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.285048 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.285025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.285104 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.285085    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.285169 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.285105    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.285293 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.285275    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.285358 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.285318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.286918 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.286897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.287381 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.287356    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.294679 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.294655    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.294927 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.294898    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f79g\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g\") pod \"e2e-api-b-78a644-openshift-default-546dff698f-hzcxg\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") " pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.461846 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.461751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:52.603419 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.603373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:08:52.608063 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:08:52.607940    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d8c2b7_90f4_4990_8790_4e43cf91cc2c.slice/crio-bd16b292336a09d62b96f4a0ef5597e5c15281d6c449725afec4edd1bb37e043 WatchSource:0}: Error finding container bd16b292336a09d62b96f4a0ef5597e5c15281d6c449725afec4edd1bb37e043: Status 404 returned error can't find the container with id bd16b292336a09d62b96f4a0ef5597e5c15281d6c449725afec4edd1bb37e043
Jul 06 20:08:52.610137 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.610102    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:08:52.610209 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.610167    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:08:52.610209 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:52.610195    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:08:53.025247 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:53.025199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerStarted","Data":"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"}
Jul 06 20:08:53.025771 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:53.025264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerStarted","Data":"bd16b292336a09d62b96f4a0ef5597e5c15281d6c449725afec4edd1bb37e043"}
Jul 06 20:08:53.050586 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:53.050535    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podStartSLOduration=1.050519297 podStartE2EDuration="1.050519297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:53.048054612 +0000 UTC m=+2161.835517655" watchObservedRunningTime="2026-07-06 20:08:53.050519297 +0000 UTC m=+2161.837982416"
Jul 06 20:08:53.462309 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:53.462215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:53.467065 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:53.467036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:54.030613 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:54.030582    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:08:54.031622 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:08:54.031600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:03.203082 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:03.203050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:09:10.071672 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:10.071626    2578 patch_prober.go:28] interesting pod/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 20:09:10.072179 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:10.071710    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:09:12.133232 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.133197    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerID="202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078" exitCode=0
Jul 06 20:09:12.133744 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.133268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerDied","Data":"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"}
Jul 06 20:09:12.133744 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.133677    2578 scope.go:117] "RemoveContainer" containerID="202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"
Jul 06 20:09:12.134684 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.134655    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:12.134749 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.134725    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:12.134786 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:12.134755    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:13.140705 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:13.140672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerStarted","Data":"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"}
Jul 06 20:09:13.462215 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:13.462120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:13.462371 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:13.462345    2578 patch_prober.go:28] interesting pod/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:09:13.462419 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:13.462393    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:09:14.462644 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:14.462611    2578 patch_prober.go:28] interesting pod/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:09:14.463045 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:14.462662    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:09:15.462731 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:15.462695    2578 patch_prober.go:28] interesting pod/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:09:15.463144 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:15.462751    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:09:16.462953 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:16.462918    2578 patch_prober.go:28] interesting pod/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 20:09:16.463365 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:16.462972    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 20:09:17.466092 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:17.466060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:17.466520 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:17.466311    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:17.467101 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:17.467085    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:18.607303 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:18.607268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:09:21.267212 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:21.267175    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:09:21.267722 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:21.267406    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy" containerID="cri-o://81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1" gracePeriod=30
Jul 06 20:09:26.525709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.525682    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:26.705379 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f79g\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705379 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705379 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705391    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705408    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705514    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs\") pod \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\" (UID: \"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c\") "
Jul 06 20:09:26.705709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705685    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:26.706086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705882    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:26.706086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705933    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-credential-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.706086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.705976    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:09:26.706086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.706056    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:26.706298 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.706282    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:26.707638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.707611    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:09:26.707638 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.707622    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g" (OuterVolumeSpecName: "kube-api-access-9f79g") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "kube-api-access-9f79g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:26.707781 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.707707    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:26.707876 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.707856    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" (UID: "f4d8c2b7-90f4-4990-8790-4e43cf91cc2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:26.806413 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806376    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-envoy\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806413 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806412    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-token\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806425    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806436    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f79g\" (UniqueName: \"kubernetes.io/projected/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-kube-api-access-9f79g\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806452    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-workload-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806464    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-data\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806494    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istio-podinfo\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:26.806636 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:26.806506    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c-istiod-ca-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:09:27.218538 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.218498    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerID="81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1" exitCode=0
Jul 06 20:09:27.218721 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.218601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"
Jul 06 20:09:27.218721 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.218639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerDied","Data":"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"}
Jul 06 20:09:27.218721 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.218692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg" event={"ID":"f4d8c2b7-90f4-4990-8790-4e43cf91cc2c","Type":"ContainerDied","Data":"bd16b292336a09d62b96f4a0ef5597e5c15281d6c449725afec4edd1bb37e043"}
Jul 06 20:09:27.218721 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.218715    2578 scope.go:117] "RemoveContainer" containerID="81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"
Jul 06 20:09:27.228488 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.228458    2578 scope.go:117] "RemoveContainer" containerID="202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"
Jul 06 20:09:27.237012 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.236995    2578 scope.go:117] "RemoveContainer" containerID="81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"
Jul 06 20:09:27.237270 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:09:27.237251    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1\": container with ID starting with 81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1 not found: ID does not exist" containerID="81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"
Jul 06 20:09:27.237325 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.237278    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1"} err="failed to get container status \"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1\": rpc error: code = NotFound desc = could not find container \"81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1\": container with ID starting with 81a8d363ba86f3332e306bbe2b81d8dfde668c4574bd9b0c8298fa25c24345f1 not found: ID does not exist"
Jul 06 20:09:27.237325 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.237297    2578 scope.go:117] "RemoveContainer" containerID="202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"
Jul 06 20:09:27.237590 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:09:27.237569    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078\": container with ID starting with 202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078 not found: ID does not exist" containerID="202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"
Jul 06 20:09:27.237662 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.237594    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078"} err="failed to get container status \"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078\": rpc error: code = NotFound desc = could not find container \"202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078\": container with ID starting with 202e12df4b69a0b6b47a94201312783a94a0582abdf13ededd432fbbb7738078 not found: ID does not exist"
Jul 06 20:09:27.272420 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.272387    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:09:27.277756 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.277733    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-78a644-openshift-default-546dff698f-hzcxg"]
Jul 06 20:09:27.839910 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:27.839868    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" path="/var/lib/kubelet/pods/f4d8c2b7-90f4-4990-8790-4e43cf91cc2c/volumes"
Jul 06 20:09:29.793713 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:29.793674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:09:30.118076 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.117992    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:09:30.118391 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.118374    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:09:30.118391 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.118392    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:09:30.118536 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.118528    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:09:30.118583 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.118540    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:09:30.123072 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.123048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.125970 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.125947    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 20:09:30.126091 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.125947    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-332acb-openshift-default-dockercfg-jtr9v\""
Jul 06 20:09:30.137369 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.137341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:09:30.138703 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.138829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.138829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.138951 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.138999 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.139040 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.138998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.139040 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.139032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.139119 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.139058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.139174 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.139125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmv6j\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.239927 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.239890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240114 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.239938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240114 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.239967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240114 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.239995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240114 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmv6j\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240114 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240384 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240384 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240384 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240585 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240536    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240651 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240742 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240717    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240887 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240775    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.240951 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.240912    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.242332 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.242315    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.242442 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.242426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.248763 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.248740    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.249460 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.249442    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmv6j\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j\") pod \"e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") " pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.434919 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.434837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:30.581774 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.581746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:09:30.582875 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:09:30.582848    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8319ca12_dca5_4ac1_a210_b3932f905ac8.slice/crio-ed185088af36607ae3fc02e6b6461e71ac0f949bbd9d1f7c7d82043c48029a38 WatchSource:0}: Error finding container ed185088af36607ae3fc02e6b6461e71ac0f949bbd9d1f7c7d82043c48029a38: Status 404 returned error can't find the container with id ed185088af36607ae3fc02e6b6461e71ac0f949bbd9d1f7c7d82043c48029a38
Jul 06 20:09:30.585105 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.585067    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:30.585230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.585149    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:30.585230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:30.585197    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:31.241451 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:31.241415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerStarted","Data":"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"}
Jul 06 20:09:31.241886 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:31.241466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerStarted","Data":"ed185088af36607ae3fc02e6b6461e71ac0f949bbd9d1f7c7d82043c48029a38"}
Jul 06 20:09:31.288574 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:31.288520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podStartSLOduration=1.288504149 podStartE2EDuration="1.288504149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:31.28777478 +0000 UTC m=+2200.075237821" watchObservedRunningTime="2026-07-06 20:09:31.288504149 +0000 UTC m=+2200.075967191"
Jul 06 20:09:31.435873 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:31.435834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:31.440848 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:31.440821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:32.246417 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:32.246384    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:32.247415 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:32.247397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:43.924194 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:43.924159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:09:44.335746 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.335717    2578 generic.go:356] "Generic (PLEG): container finished" podID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerID="5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79" exitCode=0
Jul 06 20:09:44.335954 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.335766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerDied","Data":"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"}
Jul 06 20:09:44.336145 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.336120    2578 scope.go:117] "RemoveContainer" containerID="5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"
Jul 06 20:09:44.337138 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.337105    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:44.337208 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.337191    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:44.337246 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:44.337231    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 20:09:45.343338 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:45.343304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerStarted","Data":"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"}
Jul 06 20:09:45.435786 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:45.435745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:45.436718 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:45.436695    2578 patch_prober.go:28] interesting pod/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:09:45.436803 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:45.436749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:09:46.435395 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:46.435352    2578 patch_prober.go:28] interesting pod/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:09:46.435825 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:46.435414    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:09:47.247175 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:47.247143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:47.435786 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:47.435747    2578 patch_prober.go:28] interesting pod/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:09:47.436176 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:47.435840    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:09:48.435615 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:48.435576    2578 patch_prober.go:28] interesting pod/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 06 20:09:48.435792 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:48.435635    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 06 20:09:49.439353 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:49.439324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:49.440464 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:49.440444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:09:58.807285 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:09:58.807248    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:10:24.160366 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:10:24.160284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:10:38.795378 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:10:38.795336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:10:53.845345 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:10:53.845310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:11:14.204350 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:11:14.204314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:11:28.320468 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:11:28.320420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:11:44.214196 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:11:44.214110    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:11:57.005850 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:11:57.005808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:12:12.701418 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:12:12.701382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:12:28.915714 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:12:28.915677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:12:47.604709 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:12:47.604674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:13:15.905614 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:13:15.905529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:13:56.703453 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:13:56.703418    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:14:15.134159 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:15.134119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:14:17.593441 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.593401    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:14:17.593870 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.593809    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:14:17.593870 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.593821    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d8c2b7-90f4-4990-8790-4e43cf91cc2c" containerName="istio-proxy"
Jul 06 20:14:17.597200 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.597180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.609890 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.609866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"default-dockercfg-p5b9t\""
Jul 06 20:14:17.610037 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.609899    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"openshift-service-ca.crt\""
Jul 06 20:14:17.610037 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.609866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"rate-test-model-87cbde-kserve-self-signed-certs\""
Jul 06 20:14:17.610037 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.609866    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-87cbde\"/\"kube-root-ca.crt\""
Jul 06 20:14:17.622997 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.622968    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:14:17.641284 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.641501 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.641501 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.641501 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.641501 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr2gd\" (UniqueName: \"kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.641501 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.641491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742242 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr2gd\" (UniqueName: \"kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742726 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742768 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.742845 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.742818    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.744694 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.744676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.744880 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.744864    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.761441 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.761415    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr2gd\" (UniqueName: \"kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd\") pod \"rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") " pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:17.907048 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:17.906951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:18.054109 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:18.054077    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:14:18.054987 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:14:18.054961    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa8257e6_992d_41b1_80ff_4d4f68e20768.slice/crio-33b685677a482f6d71b49059b05f0d4400061571d7d7ca1a76520471b90e8053 WatchSource:0}: Error finding container 33b685677a482f6d71b49059b05f0d4400061571d7d7ca1a76520471b90e8053: Status 404 returned error can't find the container with id 33b685677a482f6d71b49059b05f0d4400061571d7d7ca1a76520471b90e8053
Jul 06 20:14:18.815674 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:18.815634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" event={"ID":"aa8257e6-992d-41b1-80ff-4d4f68e20768","Type":"ContainerStarted","Data":"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"}
Jul 06 20:14:18.815674 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:18.815681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" event={"ID":"aa8257e6-992d-41b1-80ff-4d4f68e20768","Type":"ContainerStarted","Data":"33b685677a482f6d71b49059b05f0d4400061571d7d7ca1a76520471b90e8053"}
Jul 06 20:14:18.855015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:18.854956    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" podStartSLOduration=1.85493946 podStartE2EDuration="1.85493946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:14:18.853116029 +0000 UTC m=+2487.640579070" watchObservedRunningTime="2026-07-06 20:14:18.85493946 +0000 UTC m=+2487.642402521"
Jul 06 20:14:27.427374 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:27.427337    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:14:27.908094 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:27.908054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:27.908094 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:27.908095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:27.920962 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:27.920929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:28.879775 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:28.879747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:14:49.824068 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:14:49.824027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:15:18.597667 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:18.597629    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:15:32.836659 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:32.836620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:15:38.566332 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:38.566295    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:15:45.912666 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:45.912624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:15:53.586546 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.586458    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" podUID="aa8257e6-992d-41b1-80ff-4d4f68e20768" containerName="main" containerID="cri-o://79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33" gracePeriod=45
Jul 06 20:15:53.839451 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.839382    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:15:53.927134 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927306 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927145    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927306 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr2gd\" (UniqueName: \"kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927306 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927210    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927306 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927537 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache\") pod \"aa8257e6-992d-41b1-80ff-4d4f68e20768\" (UID: \"aa8257e6-992d-41b1-80ff-4d4f68e20768\") "
Jul 06 20:15:53.927537 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927421    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home" (OuterVolumeSpecName: "home") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:15:53.927689 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927662    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:15:53.927795 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927772    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:15:53.927853 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927841    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-model-cache\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:53.927915 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927859    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-home\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:53.927915 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.927873    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-tmp-dir\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:53.929628 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.929599    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:15:53.929829 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.929805    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm" (OuterVolumeSpecName: "dshm") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:15:53.929929 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:53.929835    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd" (OuterVolumeSpecName: "kube-api-access-wr2gd") pod "aa8257e6-992d-41b1-80ff-4d4f68e20768" (UID: "aa8257e6-992d-41b1-80ff-4d4f68e20768"). InnerVolumeSpecName "kube-api-access-wr2gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:15:54.029084 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.029048    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa8257e6-992d-41b1-80ff-4d4f68e20768-dshm\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:54.029084 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.029079    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr2gd\" (UniqueName: \"kubernetes.io/projected/aa8257e6-992d-41b1-80ff-4d4f68e20768-kube-api-access-wr2gd\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:54.029084 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.029092    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa8257e6-992d-41b1-80ff-4d4f68e20768-tls-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:15:54.329537 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.329503    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa8257e6-992d-41b1-80ff-4d4f68e20768" containerID="79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33" exitCode=0
Jul 06 20:15:54.329743 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.329610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"
Jul 06 20:15:54.329743 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.329629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" event={"ID":"aa8257e6-992d-41b1-80ff-4d4f68e20768","Type":"ContainerDied","Data":"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"}
Jul 06 20:15:54.329743 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.329662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk" event={"ID":"aa8257e6-992d-41b1-80ff-4d4f68e20768","Type":"ContainerDied","Data":"33b685677a482f6d71b49059b05f0d4400061571d7d7ca1a76520471b90e8053"}
Jul 06 20:15:54.329743 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.329678    2578 scope.go:117] "RemoveContainer" containerID="79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"
Jul 06 20:15:54.339727 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.339710    2578 scope.go:117] "RemoveContainer" containerID="79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"
Jul 06 20:15:54.340003 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:15:54.339981    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33\": container with ID starting with 79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33 not found: ID does not exist" containerID="79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"
Jul 06 20:15:54.340055 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.340011    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33"} err="failed to get container status \"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33\": rpc error: code = NotFound desc = could not find container \"79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33\": container with ID starting with 79a5d020efa6fbe1cbb256f66f6a4cc0ac18fc55796c35f3936a323a9eeb1d33 not found: ID does not exist"
Jul 06 20:15:54.362395 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.362364    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:15:54.367457 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:54.367429    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-87cbde/rate-test-model-87cbde-kserve-6ddc4fd899-nf5mk"]
Jul 06 20:15:55.838529 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:15:55.838493    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8257e6-992d-41b1-80ff-4d4f68e20768" path="/var/lib/kubelet/pods/aa8257e6-992d-41b1-80ff-4d4f68e20768/volumes"
Jul 06 20:16:29.239144 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:29.239106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5797c"]
Jul 06 20:16:34.189765 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:34.189727    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:16:34.190296 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:34.189964    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" containerID="cri-o://3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9" gracePeriod=30
Jul 06 20:16:34.442259 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:34.442170    2578 patch_prober.go:28] interesting pod/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 20:16:34.442259 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:34.442224    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 20:16:39.446140 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.446115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:16:39.554595 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554595 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554601    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554616    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554638    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554697    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmv6j\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554723    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554761    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.554838 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554825    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.555155 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy\") pod \"8319ca12-dca5-4ac1-a210-b3932f905ac8\" (UID: \"8319ca12-dca5-4ac1-a210-b3932f905ac8\") "
Jul 06 20:16:39.555155 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.554938    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:16:39.555155 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.555133    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:16:39.555324 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.555172    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-credential-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.555324 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.555229    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:16:39.555433 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.555394    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:16:39.555761 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.555733    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:16:39.556876 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.556851    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:16:39.556956 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.556903    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:16:39.557041 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.557021    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j" (OuterVolumeSpecName: "kube-api-access-lmv6j") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "kube-api-access-lmv6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:16:39.557085 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.557071    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8319ca12-dca5-4ac1-a210-b3932f905ac8" (UID: "8319ca12-dca5-4ac1-a210-b3932f905ac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:16:39.572167 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.572138    2578 generic.go:356] "Generic (PLEG): container finished" podID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerID="3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9" exitCode=0
Jul 06 20:16:39.572271 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.572175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerDied","Data":"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"}
Jul 06 20:16:39.572271 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.572186    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"
Jul 06 20:16:39.572271 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.572219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk" event={"ID":"8319ca12-dca5-4ac1-a210-b3932f905ac8","Type":"ContainerDied","Data":"ed185088af36607ae3fc02e6b6461e71ac0f949bbd9d1f7c7d82043c48029a38"}
Jul 06 20:16:39.572271 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.572240    2578 scope.go:117] "RemoveContainer" containerID="3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"
Jul 06 20:16:39.581428 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.581408    2578 scope.go:117] "RemoveContainer" containerID="5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"
Jul 06 20:16:39.589592 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.589574    2578 scope.go:117] "RemoveContainer" containerID="3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"
Jul 06 20:16:39.589892 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:16:39.589873    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9\": container with ID starting with 3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9 not found: ID does not exist" containerID="3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"
Jul 06 20:16:39.589961 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.589901    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9"} err="failed to get container status \"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9\": rpc error: code = NotFound desc = could not find container \"3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9\": container with ID starting with 3d302853f73c339eedd1ba6d35798c23c9307c92ff70da931c15171560d1afa9 not found: ID does not exist"
Jul 06 20:16:39.589961 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.589927    2578 scope.go:117] "RemoveContainer" containerID="5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"
Jul 06 20:16:39.590169 ip-10-0-135-8 kubenswrapper[2578]: E0706 20:16:39.590154    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79\": container with ID starting with 5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79 not found: ID does not exist" containerID="5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"
Jul 06 20:16:39.590212 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.590172    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79"} err="failed to get container status \"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79\": rpc error: code = NotFound desc = could not find container \"5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79\": container with ID starting with 5dc594f08a7fab796752d679767d55464a24ac05b4468388f5b673ca0f7c6a79 not found: ID does not exist"
Jul 06 20:16:39.602680 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.602629    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:16:39.605594 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.605574    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-332acb-openshift-default-578bcdfb9f-nwqgk"]
Jul 06 20:16:39.655810 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655783    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-socket\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.655810 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655808    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-envoy\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.655810 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655817    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-podinfo\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.656008 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655825    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-data\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.656008 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655833    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-istio-token\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.656008 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655841    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmv6j\" (UniqueName: \"kubernetes.io/projected/8319ca12-dca5-4ac1-a210-b3932f905ac8-kube-api-access-lmv6j\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.656008 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655850    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8319ca12-dca5-4ac1-a210-b3932f905ac8-istiod-ca-cert\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.656008 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.655859    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8319ca12-dca5-4ac1-a210-b3932f905ac8-workload-certs\") on node \"ip-10-0-135-8.ec2.internal\" DevicePath \"\""
Jul 06 20:16:39.838613 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:39.838536    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" path="/var/lib/kubelet/pods/8319ca12-dca5-4ac1-a210-b3932f905ac8/volumes"
Jul 06 20:16:40.388775 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:40.388743    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-rs44m_e3e24b25-c0f4-4b2e-9c52-d34c5d23255f/cleanup/0.log"
Jul 06 20:16:40.817644 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:40.817613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cgvgb_13448163-cd2d-4961-88b9-4554af0a6cdc/server/0.log"
Jul 06 20:16:41.073090 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:41.073013    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-6cbcl_1803646b-e9d5-4974-a97e-97da39dde6f4/copy-manifests/0.log"
Jul 06 20:16:41.087071 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:41.087044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-6cbcl_1803646b-e9d5-4974-a97e-97da39dde6f4/manager/0.log"
Jul 06 20:16:42.278279 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.278249    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/util/0.log"
Jul 06 20:16:42.286769 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.286744    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/pull/0.log"
Jul 06 20:16:42.294732 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.294714    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/extract/0.log"
Jul 06 20:16:42.407656 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.407629    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/util/0.log"
Jul 06 20:16:42.415343 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.415319    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/pull/0.log"
Jul 06 20:16:42.424425 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.424400    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/extract/0.log"
Jul 06 20:16:42.537899 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.537815    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/util/0.log"
Jul 06 20:16:42.545764 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.545739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/pull/0.log"
Jul 06 20:16:42.555388 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.555367    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/extract/0.log"
Jul 06 20:16:42.683639 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.683607    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/util/0.log"
Jul 06 20:16:42.691681 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.691653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/pull/0.log"
Jul 06 20:16:42.699400 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:42.699376    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/extract/0.log"
Jul 06 20:16:43.205703 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:43.205676    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8cmld_314a000f-035e-42d7-967a-04c59c31fda1/kuadrant-console-plugin/0.log"
Jul 06 20:16:43.570573 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:43.570544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5797c_34e9a5d9-1e2e-414f-9d55-fb32aa729391/limitador/0.log"
Jul 06 20:16:44.285626 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:44.285597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-696fc764fb-9sz8v_7b24d095-d323-4c7a-9243-9a474bddfe8a/kube-auth-proxy/0.log"
Jul 06 20:16:50.559506 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559455    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m6vl/must-gather-m2rhq"]
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559873    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559885    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559893    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559898    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559918    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8257e6-992d-41b1-80ff-4d4f68e20768" containerName="main"
Jul 06 20:16:50.559972 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.559923    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8257e6-992d-41b1-80ff-4d4f68e20768" containerName="main"
Jul 06 20:16:50.560222 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.560011    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.560222 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.560022    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8319ca12-dca5-4ac1-a210-b3932f905ac8" containerName="istio-proxy"
Jul 06 20:16:50.560222 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.560035    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8257e6-992d-41b1-80ff-4d4f68e20768" containerName="main"
Jul 06 20:16:50.564973 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.564952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.570897 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.570869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m6vl\"/\"kube-root-ca.crt\""
Jul 06 20:16:50.571958 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.571940    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4m6vl\"/\"openshift-service-ca.crt\""
Jul 06 20:16:50.572059 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.571961    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4m6vl\"/\"default-dockercfg-j9ks9\""
Jul 06 20:16:50.591891 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.591855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/must-gather-m2rhq"]
Jul 06 20:16:50.658215 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.658181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq98\" (UniqueName: \"kubernetes.io/projected/ad4a881d-cb25-421e-9cf2-fe5920d61491-kube-api-access-bzq98\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.658375 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.658303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad4a881d-cb25-421e-9cf2-fe5920d61491-must-gather-output\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.759110 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.759073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq98\" (UniqueName: \"kubernetes.io/projected/ad4a881d-cb25-421e-9cf2-fe5920d61491-kube-api-access-bzq98\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.759296 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.759162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad4a881d-cb25-421e-9cf2-fe5920d61491-must-gather-output\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.759453 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.759438    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ad4a881d-cb25-421e-9cf2-fe5920d61491-must-gather-output\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.774230 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.774197    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq98\" (UniqueName: \"kubernetes.io/projected/ad4a881d-cb25-421e-9cf2-fe5920d61491-kube-api-access-bzq98\") pod \"must-gather-m2rhq\" (UID: \"ad4a881d-cb25-421e-9cf2-fe5920d61491\") " pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:50.873809 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:50.873724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/must-gather-m2rhq"
Jul 06 20:16:51.031208 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:51.031186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/must-gather-m2rhq"]
Jul 06 20:16:51.033348 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:16:51.033321    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad4a881d_cb25_421e_9cf2_fe5920d61491.slice/crio-d75fd5c10be4517f3783f21ec4b27f29cb69bd4394ec511b5aa6957c536d968d WatchSource:0}: Error finding container d75fd5c10be4517f3783f21ec4b27f29cb69bd4394ec511b5aa6957c536d968d: Status 404 returned error can't find the container with id d75fd5c10be4517f3783f21ec4b27f29cb69bd4394ec511b5aa6957c536d968d
Jul 06 20:16:51.035189 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:51.035170    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:16:51.640665 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:51.640632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/must-gather-m2rhq" event={"ID":"ad4a881d-cb25-421e-9cf2-fe5920d61491","Type":"ContainerStarted","Data":"d75fd5c10be4517f3783f21ec4b27f29cb69bd4394ec511b5aa6957c536d968d"}
Jul 06 20:16:52.651703 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:52.651593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/must-gather-m2rhq" event={"ID":"ad4a881d-cb25-421e-9cf2-fe5920d61491","Type":"ContainerStarted","Data":"c3597729dd5e2026ca491808c55c4cb6bb3b8294eccc407396b7ae44db44b6ab"}
Jul 06 20:16:52.651703 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:52.651644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/must-gather-m2rhq" event={"ID":"ad4a881d-cb25-421e-9cf2-fe5920d61491","Type":"ContainerStarted","Data":"31d65ec9b0871d38cd38b2b3692061448034728994e3fca8b5fc01b3214f5892"}
Jul 06 20:16:52.682776 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:52.682718    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m6vl/must-gather-m2rhq" podStartSLOduration=1.513058765 podStartE2EDuration="2.682701604s" totalImagesPullingTime="1.169642839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:16:52.682118127 +0000 UTC m=+2641.469581173" watchObservedRunningTime="2026-07-06 20:16:52.682701604 +0000 UTC m=+2641.470164647"
Jul 06 20:16:53.965178 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:53.965141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-64mk7_39b49259-1e4e-474f-ab87-5b028f8b71ef/global-pull-secret-syncer/0.log"
Jul 06 20:16:54.221826 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:54.221748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kcb9m_8532c2b0-ae47-453d-9d0c-fe9c4512890d/konnectivity-agent/0.log"
Jul 06 20:16:54.320945 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:54.320908    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-8.ec2.internal_900304adc0a22b16c5b55433db5b23be/haproxy/0.log"
Jul 06 20:16:58.566458 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.566415    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/extract/0.log"
Jul 06 20:16:58.606894 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.606859    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/util/0.log"
Jul 06 20:16:58.645139 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.645106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cthkv_3f767a6e-75f7-4f5c-9761-fe23f0e97ac5/pull/0.log"
Jul 06 20:16:58.684277 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.684241    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/extract/0.log"
Jul 06 20:16:58.717080 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.717051    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/util/0.log"
Jul 06 20:16:58.758820 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.758772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mw7c9_fe2f982d-8a86-476d-87ad-16f15427a841/pull/0.log"
Jul 06 20:16:58.814059 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.814031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/extract/0.log"
Jul 06 20:16:58.853693 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.853592    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/util/0.log"
Jul 06 20:16:58.884718 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.884672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73f8grw_0049be76-8a6c-4ace-a108-ecc707ddf79e/pull/0.log"
Jul 06 20:16:58.929986 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.929951    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/extract/0.log"
Jul 06 20:16:58.977269 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:58.977235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/util/0.log"
Jul 06 20:16:59.027918 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:59.027881    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1st5qs_e175272a-2426-47f1-bba3-88d2bb1b9e4f/pull/0.log"
Jul 06 20:16:59.488227 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:59.488193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8cmld_314a000f-035e-42d7-967a-04c59c31fda1/kuadrant-console-plugin/0.log"
Jul 06 20:16:59.842882 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:16:59.842842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5797c_34e9a5d9-1e2e-414f-9d55-fb32aa729391/limitador/0.log"
Jul 06 20:17:01.670604 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.670574    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/alertmanager/0.log"
Jul 06 20:17:01.719589 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.719556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/config-reloader/0.log"
Jul 06 20:17:01.778319 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.778281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/kube-rbac-proxy-web/0.log"
Jul 06 20:17:01.825283 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.825244    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/kube-rbac-proxy/0.log"
Jul 06 20:17:01.888516 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.888466    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/kube-rbac-proxy-metric/0.log"
Jul 06 20:17:01.954251 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:01.954171    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/prom-label-proxy/0.log"
Jul 06 20:17:02.018610 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.018581    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11640270-899e-4f4d-893f-02611cd85593/init-config-reloader/0.log"
Jul 06 20:17:02.129428 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.129395    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h6hdf_0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752/kube-state-metrics/0.log"
Jul 06 20:17:02.163600 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.163572    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h6hdf_0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752/kube-rbac-proxy-main/0.log"
Jul 06 20:17:02.196399 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.196346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h6hdf_0ed3ffd6-fdf2-4a87-b2b5-1d6b3edcf752/kube-rbac-proxy-self/0.log"
Jul 06 20:17:02.300891 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.300842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-r8dmh_e101087b-af00-4377-994e-c6dac365623d/monitoring-plugin/0.log"
Jul 06 20:17:02.793244 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.793211    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s94sq_a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0/node-exporter/0.log"
Jul 06 20:17:02.825856 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.825825    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s94sq_a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0/kube-rbac-proxy/0.log"
Jul 06 20:17:02.863626 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.863589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s94sq_a94d7aa4-86e3-4e3b-aeca-9b0701ee1fb0/init-textfile/0.log"
Jul 06 20:17:02.899553 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.899462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cfx9d_9b589b86-9fa8-429b-bcd0-9d0006841132/kube-rbac-proxy-main/0.log"
Jul 06 20:17:02.944599 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.944552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cfx9d_9b589b86-9fa8-429b-bcd0-9d0006841132/kube-rbac-proxy-self/0.log"
Jul 06 20:17:02.983580 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:02.983548    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-cfx9d_9b589b86-9fa8-429b-bcd0-9d0006841132/openshift-state-metrics/0.log"
Jul 06 20:17:03.458344 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.458312    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797cffff98-w2d9h_ecf0af97-94b2-49c4-a9da-2f1d79eb128b/telemeter-client/0.log"
Jul 06 20:17:03.489370 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.489339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797cffff98-w2d9h_ecf0af97-94b2-49c4-a9da-2f1d79eb128b/reload/0.log"
Jul 06 20:17:03.521995 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.521963    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797cffff98-w2d9h_ecf0af97-94b2-49c4-a9da-2f1d79eb128b/kube-rbac-proxy/0.log"
Jul 06 20:17:03.810680 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.810633    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"]
Jul 06 20:17:03.815736 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.815704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:03.825453 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.825412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"]
Jul 06 20:17:03.991423 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.991381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-sys\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:03.991642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.991432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-proc\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:03.991642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.991458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-podres\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:03.991642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.991496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-lib-modules\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:03.991642 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:03.991559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rd6t\" (UniqueName: \"kubernetes.io/projected/4953db6f-ea38-455d-a2f4-678d9113b3ad-kube-api-access-9rd6t\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.092728 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-sys\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.092728 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-proc\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.092728 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-podres\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-lib-modules\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092762    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-sys\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-proc\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rd6t\" (UniqueName: \"kubernetes.io/projected/4953db6f-ea38-455d-a2f4-678d9113b3ad-kube-api-access-9rd6t\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092885    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-podres\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.093019 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.092888    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4953db6f-ea38-455d-a2f4-678d9113b3ad-lib-modules\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.103015 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.102981    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rd6t\" (UniqueName: \"kubernetes.io/projected/4953db6f-ea38-455d-a2f4-678d9113b3ad-kube-api-access-9rd6t\") pod \"perf-node-gather-daemonset-t68xx\" (UID: \"4953db6f-ea38-455d-a2f4-678d9113b3ad\") " pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.135086 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.135050    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.306698 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.306674    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"]
Jul 06 20:17:04.309517 ip-10-0-135-8 kubenswrapper[2578]: W0706 20:17:04.309464    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4953db6f_ea38_455d_a2f4_678d9113b3ad.slice/crio-2caecee94b4ae5fd6241a102fb538233027ae3aea19c7f425f62e63f49009f5d WatchSource:0}: Error finding container 2caecee94b4ae5fd6241a102fb538233027ae3aea19c7f425f62e63f49009f5d: Status 404 returned error can't find the container with id 2caecee94b4ae5fd6241a102fb538233027ae3aea19c7f425f62e63f49009f5d
Jul 06 20:17:04.760007 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.759974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx" event={"ID":"4953db6f-ea38-455d-a2f4-678d9113b3ad","Type":"ContainerStarted","Data":"20651917e7d576603ccf662a342f1c7f00e3217e14906d35acbb194a85f184d8"}
Jul 06 20:17:04.760343 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.760032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:04.760343 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.760050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx" event={"ID":"4953db6f-ea38-455d-a2f4-678d9113b3ad","Type":"ContainerStarted","Data":"2caecee94b4ae5fd6241a102fb538233027ae3aea19c7f425f62e63f49009f5d"}
Jul 06 20:17:04.786855 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.786785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx" podStartSLOduration=1.7867634940000001 podStartE2EDuration="1.786763494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:17:04.78311832 +0000 UTC m=+2653.570581364" watchObservedRunningTime="2026-07-06 20:17:04.786763494 +0000 UTC m=+2653.574226536"
Jul 06 20:17:04.871533 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:04.871500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rmpdh_55159b70-deb2-4ad4-ad61-f343a24ac3f2/networking-console-plugin/0.log"
Jul 06 20:17:05.984240 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:05.984210    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cb6776745-psfh7_c963dd55-ff78-42ed-9854-c633761afbe9/console/0.log"
Jul 06 20:17:06.773319 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:06.773287    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-kx6sm_7e168e64-735b-41fe-a639-22afd0798ac1/volume-data-source-validator/0.log"
Jul 06 20:17:08.089979 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:08.089947    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqwkf_048ed20c-cce5-4626-ac6a-6cb9533bca15/dns/0.log"
Jul 06 20:17:08.132863 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:08.132833    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqwkf_048ed20c-cce5-4626-ac6a-6cb9533bca15/kube-rbac-proxy/0.log"
Jul 06 20:17:08.268895 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:08.268861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6rfnr_b8461668-f6be-4f40-a905-72962797ced2/dns-node-resolver/0.log"
Jul 06 20:17:09.115063 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:09.115033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s4vht_66f3e19b-bc18-49be-a80c-0d8b141bc79b/node-ca/0.log"
Jul 06 20:17:10.440987 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:10.440958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-696fc764fb-9sz8v_7b24d095-d323-4c7a-9243-9a474bddfe8a/kube-auth-proxy/0.log"
Jul 06 20:17:10.782122 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:10.782081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4m6vl/perf-node-gather-daemonset-t68xx"
Jul 06 20:17:11.477210 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:11.477180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gc5fz_91ac4c6f-507e-4a81-be9a-226217d18ebe/serve-healthcheck-canary/0.log"
Jul 06 20:17:12.166246 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:12.166215    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-dwmmp_f61458c5-d7c0-4c4f-bad2-413b1b47f6eb/insights-operator/0.log"
Jul 06 20:17:12.166955 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:12.166927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-dwmmp_f61458c5-d7c0-4c4f-bad2-413b1b47f6eb/insights-operator/1.log"
Jul 06 20:17:12.278952 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:12.278922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7b22_c20516ce-c171-4e62-a376-49bcc8073222/kube-rbac-proxy/0.log"
Jul 06 20:17:12.309276 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:12.309239    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7b22_c20516ce-c171-4e62-a376-49bcc8073222/exporter/0.log"
Jul 06 20:17:12.343626 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:12.343595    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7b22_c20516ce-c171-4e62-a376-49bcc8073222/extractor/0.log"
Jul 06 20:17:14.690499 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:14.690419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-696fc764fb-9sz8v_7b24d095-d323-4c7a-9243-9a474bddfe8a/kube-auth-proxy/0.log"
Jul 06 20:17:15.465342 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:15.465316    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-rs44m_e3e24b25-c0f4-4b2e-9c52-d34c5d23255f/cleanup/0.log"
Jul 06 20:17:15.632148 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:15.632118    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cgvgb_13448163-cd2d-4961-88b9-4554af0a6cdc/server/0.log"
Jul 06 20:17:15.820175 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:15.820140    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-6cbcl_1803646b-e9d5-4974-a97e-97da39dde6f4/manager/0.log"
Jul 06 20:17:15.849237 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:15.849208    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f6756874-6cbcl_1803646b-e9d5-4974-a97e-97da39dde6f4/copy-manifests/0.log"
Jul 06 20:17:16.141835 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:16.141810    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-696fc764fb-9sz8v_7b24d095-d323-4c7a-9243-9a474bddfe8a/kube-auth-proxy/0.log"
Jul 06 20:17:17.482893 ip-10-0-135-8 kubenswrapper[2578]: I0706 20:17:17.482858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fdd95bb87-s8pgp_dd8fb0da-86e7-42b0-ad22-51eee25abbdd/manager/0.log"