Jul 10 00:15:39.021261 ip-10-0-141-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 00:15:39.021270 ip-10-0-141-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 00:15:39.021279 ip-10-0-141-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 00:15:39.021492 ip-10-0-141-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 00:15:49.188735 ip-10-0-141-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 00:15:49.188750 ip-10-0-141-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bbff19fd918f4d6a93f88da3ed4be279 --
Jul 10 00:17:55.398104 ip-10-0-141-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 00:17:55.830107 ip-10-0-141-199 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 00:17:55.830107 ip-10-0-141-199 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 00:17:55.830107 ip-10-0-141-199 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 00:17:55.830107 ip-10-0-141-199 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 00:17:55.830107 ip-10-0-141-199 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 00:17:55.830780 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.830122    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 00:17:55.835102 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835082    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.835102 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835100    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835104    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835108    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835111    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835114    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835117    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835120    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835123    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835126    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835128    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835131    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835134    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835138    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835141    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835144    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835154    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835158    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835163    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835168    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835172    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.835175 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835177    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835181    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835186    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835192    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835196    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835199    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835202    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835204    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835207    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835210    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835213    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835215    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835220    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835224    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835228    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835231    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835234    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835239    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835243    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.835670 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835246    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835249    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835252    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835257    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835260    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835263    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835266    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835269    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835272    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835275    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835278    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835281    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835284    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835287    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835290    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835294    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835297    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835300    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835303    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835306    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.836215 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835309    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835311    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835314    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835317    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835320    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835322    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835325    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835328    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835331    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835333    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835336    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835339    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835343    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835346    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835348    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835351    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835354    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835356    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835359    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835361    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.836730 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835364    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835366    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835369    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835372    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835374    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835377    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835380    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835384    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835387    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835390    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835393    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835395    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835400    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835404    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835407    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835410    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835413    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835416    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.835419    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.837242 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836229    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836236    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836240    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836243    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836246    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836249    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836252    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836255    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836258    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836261    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836264    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836267    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836269    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836272    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836275    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836278    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836281    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836284    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836287    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.837711 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836289    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836294    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836296    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836300    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836305    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836310    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836314    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836317    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836320    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836323    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836326    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836330    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836333    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836336    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836339    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836342    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836344    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836348    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836351    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.838214 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836354    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836357    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836360    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836362    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836365    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836368    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836372    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836375    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836378    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836380    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836383    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836386    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836391    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836395    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836398    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836401    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836404    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836407    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836410    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836413    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.838705 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836416    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836418    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836422    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836424    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836427    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836430    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836433    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836435    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836438    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836441    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836444    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836446    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836449    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836452    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836455    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836458    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836461    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836465    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836468    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836470    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.839236 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836473    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836476    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836479    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836481    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836484    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836487    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836489    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836492    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836496    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836499    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836502    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836505    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836508    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836510    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836514    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836516    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836519    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836522    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836525    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836527    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.839775 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836530    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836950    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836956    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836959    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836962    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836965    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836969    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836972    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836975    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836978    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836981    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836985    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836987    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836990    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836993    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836996    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.836999    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837001    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837004    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837007    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.840308 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837010    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837013    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837016    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837018    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837021    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837024    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837027    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837030    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837033    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837035    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837038    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837041    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837044    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837047    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837049    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837052    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837054    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837057    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837060    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837064    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.840807 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837067    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837070    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837073    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837076    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837078    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837081    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837084    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837087    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837089    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837092    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837094    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837097    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837100    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837103    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837106    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837108    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837113    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837119    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837122    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.841377 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837125    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837129    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837131    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837134    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837137    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837140    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837145    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837148    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837151    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837158    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837161    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837164    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837167    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837170    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837173    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837175    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837178    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837181    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837184    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837186    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.841859 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837189    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837192    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837195    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837198    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837200    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837203    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837206    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837208    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837211    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837214    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837216    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837220    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837222    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837225    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837228    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837231    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837233    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837236    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837238    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837241    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.842387 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.837244    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837321    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837332    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837341    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837348    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837354    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837360    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837367    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837372    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837375    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837379    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837382    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837386    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837390    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837394    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837397    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837400    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837404    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837408    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837412    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837416    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837419    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837423    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837426    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 00:17:55.842954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837430    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837433    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837437    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837441    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837444    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837447    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837451    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837454    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837457    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837463    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837466    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837469    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837472    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837475    2575 flags.go:64] FLAG: --enable-server="true"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837479    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837484    2575 flags.go:64] FLAG: --event-burst="100"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837488    2575 flags.go:64] FLAG: --event-qps="50"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837491    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837494    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837498    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837501    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837506    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837509    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837513    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837516    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 00:17:55.843564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837519    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837522    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837526    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837529    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837532    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837535    2575 flags.go:64] FLAG: --feature-gates=""
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837539    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837542    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837546    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837549    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837552    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837556    2575 flags.go:64] FLAG: --help="false"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837559    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-199.ec2.internal"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837562    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837565    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837568    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837574    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837577    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837580    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837583    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837587    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837589    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837593    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837597    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 00:17:55.844219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837600    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837603    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837606    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837610    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837614    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837618    2575 flags.go:64] FLAG: --lock-file=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837620    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837624    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837627    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837633    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837636    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837639    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837642    2575 flags.go:64] FLAG: --logging-format="text"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837646    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837649    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837652    2575 flags.go:64] FLAG: --manifest-url=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837655    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837659    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837663    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837667    2575 flags.go:64] FLAG: --max-pods="110"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837670    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837673    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837676    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837679    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837684    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 00:17:55.844887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837687    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837690    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837698    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837701    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837705    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837709    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837712    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837718    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837721    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837725    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837728    2575 flags.go:64] FLAG: --port="10250"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837734    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837737    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad84c1af3a7b87fc"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837740    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837743    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837747    2575 flags.go:64] FLAG: --register-node="true"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837750    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837754    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837757    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837760    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837763    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837767    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837770    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837773    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837776    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 00:17:55.845784 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837779    2575 flags.go:64] FLAG: --runonce="false"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837783    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837786    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837789    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837792    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837795    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837798    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837802    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837806    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837809    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837812    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837815    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837818    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837821    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837824    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837828    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837834    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837837    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837842    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837846    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837849    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837852    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837855    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837858    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837861    2575 flags.go:64] FLAG: --v="2"
Jul 10 00:17:55.846730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837865    2575 flags.go:64] FLAG: --version="false"
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837870    2575 flags.go:64] FLAG: --vmodule=""
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837874    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.837877    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838044    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838051    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838054    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838058    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838061    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838064    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838067    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838070    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838073    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838076    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838079    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838082    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838085    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838089    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838092    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838094    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.847475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838098    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838102    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838106    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838115    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838118    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838123    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838126    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838129    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838132    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838134    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838146    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838149    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838152    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838155    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838158    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838160    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838163    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838167    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838171    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.848014 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838174    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838178    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838182    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838186    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838189    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838192    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838194    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838197    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838200    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838203    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838206    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838209    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838211    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838214    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838217    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838220    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838223    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838232    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838238    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.848507 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838240    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838243    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838246    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838248    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838251    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838254    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838257    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838260    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838262    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838265    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838268    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838271    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838273    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838276    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838278    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838281    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838284    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838286    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838289    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.849013 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838292    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838294    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838297    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838300    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838303    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838305    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838308    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838311    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838313    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838316    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838319    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838321    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838331    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838334    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838337    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838340    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838342    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838345    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838348    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838351    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.849511 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838353    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838356    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838359    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838361    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838364    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.838367    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.839037    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.848883    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.848901    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.849616    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.849624    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849696    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849703    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849706    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849709    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.850046 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849712    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849715    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849718    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849721    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849724    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849727    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849729    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849732    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849735    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849738    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849741    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849743    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849746    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849749    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849753    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849755    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849759    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849762    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849764    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849767    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.850530 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849770    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849773    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849776    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849779    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849782    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849787    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849792    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849796    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849799    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849803    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849806    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849809    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849812    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849815    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849818    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849821    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849824    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849827    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849831    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.851066 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849834    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849837    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849840    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849842    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849845    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849848    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849851    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849854    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849856    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849860    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849863    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849866    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849869    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849872    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849875    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849878    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849880    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849883    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849886    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849889    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.851579 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849892    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849895    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849898    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849900    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849903    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849921    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849925    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849927    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849930    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849933    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849936    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849939    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849942    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849945    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849948    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849950    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849954    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849957    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849960    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.852118 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849963    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849966    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849968    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849971    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849974    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849976    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849979    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849982    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849985    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849988    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849991    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849995    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.849997    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850000    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850004    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850008    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.852603 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850011    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.850017    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850155    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850162    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850166    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850169    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850172    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850175    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850178    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850181    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850184    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850188    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850190    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850193    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 00:17:55.853072 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850200    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850203    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850206    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850209    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850211    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850214    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850217    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850220    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850223    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850226    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850229    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850233    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850237    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850240    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850244    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850247    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850250    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850254    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850257    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 00:17:55.853442 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850260    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850262    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850265    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850268    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850271    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850274    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850276    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850279    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850281    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850285    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850287    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850290    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850293    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850297    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850301    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850304    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850308    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850310    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850313    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 00:17:55.854030 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850316    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850319    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850322    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850325    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850328    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850331    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850334    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850337    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850340    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850343    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850345    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850348    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850351    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850354    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850357    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850359    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850362    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850365    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850368    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850370    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 00:17:55.854526 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850373    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850376    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850379    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850381    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850384    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850387    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850389    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850392    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850396    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850399    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850401    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850404    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850407    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850409    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850412    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850415    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850417    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850420    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850423    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850425    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 00:17:55.855056 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850428    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850430    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850433    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850436    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850438    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850441    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850444    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850447    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:55.850449    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.850455    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.850613    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.853410    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.854944    2575 server.go:1019] "Starting client certificate rotation"
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.855052    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 00:17:55.855590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.855082    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 00:17:55.857811 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.857796    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 00:17:55.860223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.860207    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 00:17:55.868720 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.868702    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 10 00:17:55.874082 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.874065    2575 log.go:25] "Validated CRI v1 image API"
Jul 10 00:17:55.876636 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.876615    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 00:17:55.879129 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.879097    2575 fs.go:135] Filesystem UUIDs: map[08784b59-4e34-442c-ad68-ff6489919b9f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c78e8e7b-0e57-4f2e-b6a4-4628ce14f983:/dev/nvme0n1p3]
Jul 10 00:17:55.879181 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.879130    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 00:17:55.885107 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.885080    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 00:17:55.888039 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.887923    2575 manager.go:216] Machine: {Timestamp:2026-07-10 00:17:55.884655115 +0000 UTC m=+0.369946399 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3165010 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a48a582616b81e5605fd81a71e24f SystemUUID:ec2a48a5-8261-6b81-e560-5fd81a71e24f BootID:bbff19fd-918f-4d6a-93f8-8da3ed4be279 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:c5:e5:31:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:c5:e5:31:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:fc:82:81:8b:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 00:17:55.888039 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.888038    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 00:17:55.888162 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.888130    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 00:17:55.891787 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.891761    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 00:17:55.891944 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.891791    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 00:17:55.892527 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.892516    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 00:17:55.892567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.892530    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 00:17:55.892567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.892538    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 00:17:55.893143 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.893132    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 00:17:55.894531 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.894520    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 00:17:55.897567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897554    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 00:17:55.897734 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897723    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 00:17:55.897779 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897755    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 00:17:55.897779 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897766    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 00:17:55.897920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897780    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 00:17:55.897920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897790    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 10 00:17:55.897920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.897799    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 00:17:55.898273 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.898258    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 00:17:55.898331 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.898283    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 00:17:55.900987 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.900964    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 00:17:55.903144 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903113    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 00:17:55.903202 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903163    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 00:17:55.903372 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903361    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 00:17:55.903415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903379    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 00:17:55.903415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903386    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 00:17:55.903415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903392    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 00:17:55.903415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903401    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 00:17:55.903415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903407    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 00:17:55.903873 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903863    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 00:17:55.903873 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903873    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 00:17:55.903958 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903882    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 00:17:55.903958 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903888    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 00:17:55.903958 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903897    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 00:17:55.903958 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.903923    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 00:17:55.904675 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.904663    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 00:17:55.904675 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.904673    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 00:17:55.907970 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.907948    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 00:17:55.908058 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.908001    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 00:17:55.908058 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.908038    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 00:17:55.908291 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.908277    2575 server.go:1268] "Started kubelet"
Jul 10 00:17:55.908442 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.908379    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 00:17:55.908580 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.908452    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 00:17:55.908736 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.908717    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 00:17:55.909419 ip-10-0-141-199 systemd[1]: Started Kubernetes Kubelet.
Jul 10 00:17:55.910463 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.910261    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 00:17:55.911039 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.911023    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 00:17:55.914330 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.914309    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 00:17:55.915772 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.915753    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 00:17:55.915772 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.915770    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 00:17:55.916007 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.915990    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:55.916646 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.915291    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-199.ec2.internal.18c0c59047bcfce0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-199.ec2.internal,UID:ip-10-0-141-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-199.ec2.internal,},FirstTimestamp:2026-07-10 00:17:55.908246752 +0000 UTC m=+0.393538037,LastTimestamp:2026-07-10 00:17:55.908246752 +0000 UTC m=+0.393538037,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-199.ec2.internal,}"
Jul 10 00:17:55.916761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916670    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 00:17:55.916761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916686    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 00:17:55.916761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916649    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 00:17:55.916946 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916804    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 00:17:55.916946 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916812    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 00:17:55.916946 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916931    2575 factory.go:55] Registering systemd factory
Jul 10 00:17:55.917071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.916949    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 10 00:17:55.917206 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.917187    2575 factory.go:153] Registering CRI-O factory
Jul 10 00:17:55.917206 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.917204    2575 factory.go:223] Registration of the crio container factory successfully
Jul 10 00:17:55.917371 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.917274    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 00:17:55.917371 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.917297    2575 factory.go:103] Registering Raw factory
Jul 10 00:17:55.917371 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.917315    2575 manager.go:1196] Started watching for new ooms in manager
Jul 10 00:17:55.918202 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.918183    2575 manager.go:349] Starting recovery of all containers
Jul 10 00:17:55.920086 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.920050    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7h2f"
Jul 10 00:17:55.922035 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.922001    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 00:17:55.922183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.922154    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 00:17:55.926552 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.926523    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k7h2f"
Jul 10 00:17:55.934579 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.934426    2575 manager.go:354] Recovery completed
Jul 10 00:17:55.939210 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.939195    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:55.942191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942174    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:55.942262 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942204    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:55.942262 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942215    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:55.942758 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942742    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 00:17:55.942758 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942754    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 00:17:55.942758 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942755    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:55.942970 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.942769    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 00:17:55.943538 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.943521    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:55.943615 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.943555    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:55.943615 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.943571    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:55.944146 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.944131    2575 policy_none.go:49] "None policy: Start"
Jul 10 00:17:55.944207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.944151    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 00:17:55.944207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.944166    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 00:17:55.944281 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.944143    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-199.ec2.internal.18c0c59049c2e98e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-199.ec2.internal,UID:ip-10-0-141-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-199.ec2.internal,},FirstTimestamp:2026-07-10 00:17:55.942189454 +0000 UTC m=+0.427480738,LastTimestamp:2026-07-10 00:17:55.942189454 +0000 UTC m=+0.427480738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-199.ec2.internal,}"
Jul 10 00:17:55.945293 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.945280    2575 policy_none.go:47] "Start"
Jul 10 00:17:55.984621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.984601    2575 manager.go:337] "Starting Device Plugin manager"
Jul 10 00:17:55.984714 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.984654    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 00:17:55.984714 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.984665    2575 server.go:87] "Starting device plugin registration server"
Jul 10 00:17:55.985057 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.985042    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 00:17:55.985123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.985060    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 00:17:55.985215 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.985194    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 00:17:55.985365 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.985347    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 00:17:55.985365 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:55.985362    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 00:17:55.986140 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.986112    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 00:17:55.986228 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:55.986176    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.088017 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.087946    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:56.089182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.089047    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:56.089182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.089080    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:56.089182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.089100    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:56.089182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.089127    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.097582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.097557    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.097699 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.097590    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-199.ec2.internal\": node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.112309 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.112280    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.183229 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.183192    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 00:17:56.184689 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.184673    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 00:17:56.184764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.184711    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 00:17:56.184764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.184738    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 00:17:56.184855 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.184775    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 00:17:56.187295 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.187261    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:56.213234 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.213193    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.285605 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.285546    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"]
Jul 10 00:17:56.285718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.285650    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:56.287547 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.287532    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:56.287619 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.287562    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:56.287619 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.287583    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:56.289120 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289106    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:56.289252 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289235    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.289304 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289287    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:56.289930 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289909    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:56.290007 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289932    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:56.290007 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289957    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:56.290007 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289967    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:56.290007 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.289938    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:56.290170 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.290021    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:56.292240 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.292223    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.292291 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.292258    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 00:17:56.292977 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.292958    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 00:17:56.293043 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.292989    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 00:17:56.293043 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.293004    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeHasSufficientPID"
Jul 10 00:17:56.313598 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.313575    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.319184 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.319164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.319272 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.319189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d58ff4672371e2d87fef8bb390ed631a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-199.ec2.internal\" (UID: \"d58ff4672371e2d87fef8bb390ed631a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.319272 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.319208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.325640 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.325623    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-199.ec2.internal\" not found" node="ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.330145 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.330127    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-199.ec2.internal\" not found" node="ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.414596 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.414495    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.420338 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.420416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420350    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.420416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d58ff4672371e2d87fef8bb390ed631a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-199.ec2.internal\" (UID: \"d58ff4672371e2d87fef8bb390ed631a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.420416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d58ff4672371e2d87fef8bb390ed631a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-199.ec2.internal\" (UID: \"d58ff4672371e2d87fef8bb390ed631a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.420517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.420517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.420426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea13881fc04fc1dd88d8f5520e282e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal\" (UID: \"dea13881fc04fc1dd88d8f5520e282e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.522337 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.522295    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.622772 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.622738    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.628336 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.628314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.633693 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.633674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:56.723535 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.723435    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.790592 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.790556    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:56.823919 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.823882    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.854179 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.854148    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 00:17:56.854667 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.854312    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 00:17:56.854667 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.854320    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 00:17:56.924817 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:56.924787    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-199.ec2.internal\" not found"
Jul 10 00:17:56.930354 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.930323    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 00:12:56 +0000 UTC" deadline="2028-01-26 01:37:55.233889208 +0000 UTC"
Jul 10 00:17:56.930354 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.930353    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13561h19m58.303538956s"
Jul 10 00:17:56.939894 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:56.939872    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:57.016217 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.016128    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:57.029659 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.029631    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 00:17:57.031080 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.031065    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal"
Jul 10 00:17:57.040326 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.040294    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 00:17:57.179208 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:57.179165    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea13881fc04fc1dd88d8f5520e282e2.slice/crio-8a073c63bc988c4a9b181a3232ce003eee327b806c2d9bc374e386c79075e519 WatchSource:0}: Error finding container 8a073c63bc988c4a9b181a3232ce003eee327b806c2d9bc374e386c79075e519: Status 404 returned error can't find the container with id 8a073c63bc988c4a9b181a3232ce003eee327b806c2d9bc374e386c79075e519
Jul 10 00:17:57.179470 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:57.179446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58ff4672371e2d87fef8bb390ed631a.slice/crio-49313b5917d8f68d8b325599cd02107b1c62b37ebc1a027d25f3db231ca4e42f WatchSource:0}: Error finding container 49313b5917d8f68d8b325599cd02107b1c62b37ebc1a027d25f3db231ca4e42f: Status 404 returned error can't find the container with id 49313b5917d8f68d8b325599cd02107b1c62b37ebc1a027d25f3db231ca4e42f
Jul 10 00:17:57.184395 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.184375    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 00:17:57.188207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.188162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal" event={"ID":"dea13881fc04fc1dd88d8f5520e282e2","Type":"ContainerStarted","Data":"8a073c63bc988c4a9b181a3232ce003eee327b806c2d9bc374e386c79075e519"}
Jul 10 00:17:57.189132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.189113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal" event={"ID":"d58ff4672371e2d87fef8bb390ed631a","Type":"ContainerStarted","Data":"49313b5917d8f68d8b325599cd02107b1c62b37ebc1a027d25f3db231ca4e42f"}
Jul 10 00:17:57.437491 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.437407    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:57.899116 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.899029    2575 apiserver.go:52] "Watching apiserver"
Jul 10 00:17:57.908097 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.908068    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 00:17:57.908586 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.908529    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-p6pqz","kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd","openshift-cluster-node-tuning-operator/tuned-h8m6b","openshift-image-registry/node-ca-r97px","openshift-multus/multus-gdv5d","openshift-network-diagnostics/network-check-target-q987s","openshift-dns/node-resolver-pqqjj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-4bnl6","openshift-multus/network-metrics-daemon-qhs8w","openshift-network-operator/iptables-alerter-8cl8b","openshift-ovn-kubernetes/ovnkube-node-zth6x","kube-system/global-pull-secret-syncer-czjs4"]
Jul 10 00:17:57.910364 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.910337    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:57.910475 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:57.910442    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:17:57.911965 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.911936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.913430 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.913401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.915385 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.914708    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.916103 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.916079    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 00:17:57.916201 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.916177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:57.916990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.916958    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 00:17:57.917090 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.916987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.917158 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917113    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.917158 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917144    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.917261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 00:17:57.917394 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjs5d\""
Jul 10 00:17:57.917394 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917386    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 00:17:57.917516 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9dtgm\""
Jul 10 00:17:57.917570 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917521    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 00:17:57.917570 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917547    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.917743 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.917725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.918541 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.918517    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.919182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.918683    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 00:17:57.919182 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.918730    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.919941 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.919726    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.919941 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.919822    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:57.920538 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:57.920140    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:17:57.920538 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.920258    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ns7hv\""
Jul 10 00:17:57.921466 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.921448    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.921828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.921612    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 00:17:57.921828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.921750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cnzl5\""
Jul 10 00:17:57.923369 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.923313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:57.923740 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.923714    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 00:17:57.923898 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.923850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4pdxd\""
Jul 10 00:17:57.923999 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.923723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 00:17:57.924064 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.924050    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.924122 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.924063    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.925632 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.925605    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 00:17:57.925919 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.925897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:57.926309 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.926258    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 00:17:57.926396 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.926331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z5t2p\""
Jul 10 00:17:57.927121 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.927099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:57.927121 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.927112    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 00:17:57.928718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.928698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:57.928818 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:57.928792    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:17:57.929184 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.929161    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lbvjh\""
Jul 10 00:17:57.929314 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.929193    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.929514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.929496    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 00:17:57.929595 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.929531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.930610 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.929793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 00:17:57.930610 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.930030    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8c825\""
Jul 10 00:17:57.930610 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.930096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:57.931996 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.931964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-system-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.932090 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-systemd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.932090 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-os-release\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.932090 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysconfig\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-host\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-cni-binary-copy\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-kubelet\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.932253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-etc-kubernetes\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-registration-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-kubelet\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-device-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfwl\" (UniqueName: \"kubernetes.io/projected/4be39260-f4a4-4991-b874-088a38bc9677-kube-api-access-tzfwl\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-kubernetes\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-modprobe-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-host\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.932537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-socket-dir-parent\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-multus-certs\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-netns\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-etc-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-k8s-cni-cncf-io\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-netns\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovn-node-metrics-cert\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wbhs\" (UniqueName: \"kubernetes.io/projected/520a3cbc-2f67-48b8-bf8b-29fb329f2586-kube-api-access-7wbhs\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-var-lib-kubelet\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-bin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-multus\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-multus-daemon-config\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-systemd-units\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-node-log\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-config\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.932996    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wf4s2\""
Jul 10 00:17:57.933060 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-sys-fs\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-log-socket\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-conf\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-tmp\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933281    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-sys\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-cnibin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-conf-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-var-lib-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmklt\" (UniqueName: \"kubernetes.io/projected/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-kube-api-access-kmklt\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmj4r\" (UniqueName: \"kubernetes.io/projected/19d7be9b-40c7-4a9d-b928-95e629872529-kube-api-access-gmj4r\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-ovn\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-env-overrides\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933470    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-socket-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-lib-modules\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-serviceca\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:57.933838 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933511    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-systemd\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2fn7\" (UniqueName: \"kubernetes.io/projected/3be34c12-518a-4270-ad7d-890bb2a4c4f9-kube-api-access-z2fn7\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-run\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-hostroot\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-script-lib\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-slash\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-bin\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933699    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933710    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-netd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:57.934796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.933790    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-tuned\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:57.949808 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.949782    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-npnpf"
Jul 10 00:17:57.957451 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:57.957388    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-npnpf"
Jul 10 00:17:58.007425 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.007398    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:58.017698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.017678    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 00:17:58.034630 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.034630 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-sys\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgl6\" (UniqueName: \"kubernetes.io/projected/56a71be3-f920-4543-8aca-caaa777619e1-kube-api-access-5fgl6\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-cnibin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-conf-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-var-lib-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmklt\" (UniqueName: \"kubernetes.io/projected/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-kube-api-access-kmklt\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmj4r\" (UniqueName: \"kubernetes.io/projected/19d7be9b-40c7-4a9d-b928-95e629872529-kube-api-access-gmj4r\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-ovn\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.034870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-env-overrides\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-socket-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-lib-modules\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-system-cni-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.034998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-serviceca\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-systemd\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2fn7\" (UniqueName: \"kubernetes.io/projected/3be34c12-518a-4270-ad7d-890bb2a4c4f9-kube-api-access-z2fn7\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-binary-copy\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313ae437-78a7-4cab-afe5-8d18d65f4732-host-slash\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-run\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/313ae437-78a7-4cab-afe5-8d18d65f4732-iptables-alerter-script\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-hostroot\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-script-lib\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04f0a9e2-9f73-4203-9631-e2e610dc272a-konnectivity-ca\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-slash\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-bin\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtn29\" (UniqueName: \"kubernetes.io/projected/313ae437-78a7-4cab-afe5-8d18d65f4732-kube-api-access-wtn29\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56a71be3-f920-4543-8aca-caaa777619e1-hosts-file\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-netd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-etc-selinux\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-tuned\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-kubelet-config\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-sys\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-dbus\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04f0a9e2-9f73-4203-9631-e2e610dc272a-agent-certs\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-system-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-ovn\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.035979 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-systemd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-os-release\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.035997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cnibin\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48gr\" (UniqueName: \"kubernetes.io/projected/071727e1-8d42-48ba-b5f7-9f9ef22d5781-kube-api-access-s48gr\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-hostroot\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-cnibin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-conf-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036241    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-var-lib-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysconfig\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-socket-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-system-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-netd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.036816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.037666 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036460    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-systemd\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.037666 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-lib-modules\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.037666 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-run\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.037666 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-env-overrides\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.037666 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.037536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-serviceca\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.037928 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.037900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-script-lib\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.037994 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.037928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-host\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.038055 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-slash\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.038055 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038034    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysconfig\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-systemd\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.036326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-host\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-cni-binary-copy\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-os-release\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-cni-bin\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-kubelet\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038576    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-etc-kubernetes\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-registration-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-kubelet\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-device-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfwl\" (UniqueName: \"kubernetes.io/projected/4be39260-f4a4-4991-b874-088a38bc9677-kube-api-access-tzfwl\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-kubernetes\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-modprobe-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.039098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-host\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-device-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhlz8\" (UniqueName: \"kubernetes.io/projected/5a795161-ed87-4547-94f9-1cf3a22652bf-kube-api-access-bhlz8\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.038968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-cni-binary-copy\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-kubelet\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-run-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039749    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-etc-kubernetes\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-socket-dir-parent\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-registration-dir\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-kubelet\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.039973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-kubernetes\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.040132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-modprobe-d\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-host\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-multus-certs\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-netns\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-etc-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-k8s-cni-cncf-io\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-netns\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovn-node-metrics-cert\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wbhs\" (UniqueName: \"kubernetes.io/projected/520a3cbc-2f67-48b8-bf8b-29fb329f2586-kube-api-access-7wbhs\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.040731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-var-lib-kubelet\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-os-release\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-bin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-multus\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-multus-daemon-config\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-systemd-units\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.040955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-node-log\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-config\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-sys-fs\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-log-socket\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.041223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-conf\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.041752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-tmp\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.041752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56a71be3-f920-4543-8aca-caaa777619e1-tmp-dir\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.041752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.041752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-cni-dir\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.041752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-node-log\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.042043 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.041985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-multus\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.042100 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-host-run-netns\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.042162 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-multus-socket-dir-parent\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.042162 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-multus-certs\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.042259 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-etc-openvswitch\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.042259 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-k8s-cni-cncf-io\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.042360 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-run-netns\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.042417 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4be39260-f4a4-4991-b874-088a38bc9677-sys-fs\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.042887 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.042863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovnkube-config\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.043055 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-sysctl-conf\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.043121 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043064    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/19d7be9b-40c7-4a9d-b928-95e629872529-multus-daemon-config\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.043238 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19d7be9b-40c7-4a9d-b928-95e629872529-host-var-lib-cni-bin\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.043853 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043419    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3be34c12-518a-4270-ad7d-890bb2a4c4f9-var-lib-kubelet\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.043853 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-systemd-units\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.043853 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.043700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/520a3cbc-2f67-48b8-bf8b-29fb329f2586-log-socket\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.045609 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.045520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/520a3cbc-2f67-48b8-bf8b-29fb329f2586-ovn-node-metrics-cert\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.045828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.045783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmj4r\" (UniqueName: \"kubernetes.io/projected/19d7be9b-40c7-4a9d-b928-95e629872529-kube-api-access-gmj4r\") pod \"multus-gdv5d\" (UID: \"19d7be9b-40c7-4a9d-b928-95e629872529\") " pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.046945 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.046921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-tmp\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.047616 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.047593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3be34c12-518a-4270-ad7d-890bb2a4c4f9-etc-tuned\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.051203 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.050329    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:17:58.051203 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.050362    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:17:58.051203 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.050376    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:58.051203 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.050444    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:17:58.550419374 +0000 UTC m=+3.035710662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:58.053177 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.053152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfwl\" (UniqueName: \"kubernetes.io/projected/4be39260-f4a4-4991-b874-088a38bc9677-kube-api-access-tzfwl\") pod \"aws-ebs-csi-driver-node-xvwkd\" (UID: \"4be39260-f4a4-4991-b874-088a38bc9677\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.053567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.053546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2fn7\" (UniqueName: \"kubernetes.io/projected/3be34c12-518a-4270-ad7d-890bb2a4c4f9-kube-api-access-z2fn7\") pod \"tuned-h8m6b\" (UID: \"3be34c12-518a-4270-ad7d-890bb2a4c4f9\") " pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.053800 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.053752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmklt\" (UniqueName: \"kubernetes.io/projected/6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0-kube-api-access-kmklt\") pod \"node-ca-r97px\" (UID: \"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0\") " pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.056223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.056203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wbhs\" (UniqueName: \"kubernetes.io/projected/520a3cbc-2f67-48b8-bf8b-29fb329f2586-kube-api-access-7wbhs\") pod \"ovnkube-node-zth6x\" (UID: \"520a3cbc-2f67-48b8-bf8b-29fb329f2586\") " pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.142308 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtn29\" (UniqueName: \"kubernetes.io/projected/313ae437-78a7-4cab-afe5-8d18d65f4732-kube-api-access-wtn29\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.142308 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56a71be3-f920-4543-8aca-caaa777619e1-hosts-file\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-kubelet-config\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-dbus\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04f0a9e2-9f73-4203-9631-e2e610dc272a-agent-certs\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142471    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-kubelet-config\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.142549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142521    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56a71be3-f920-4543-8aca-caaa777619e1-hosts-file\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.142555    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/940c64ff-1336-490c-8ce0-42f2ad0fdedb-dbus\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cnibin\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.142621    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:17:58.642602533 +0000 UTC m=+3.127893820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cnibin\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s48gr\" (UniqueName: \"kubernetes.io/projected/071727e1-8d42-48ba-b5f7-9f9ef22d5781-kube-api-access-s48gr\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhlz8\" (UniqueName: \"kubernetes.io/projected/5a795161-ed87-4547-94f9-1cf3a22652bf-kube-api-access-bhlz8\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142746    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-os-release\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56a71be3-f920-4543-8aca-caaa777619e1-tmp-dir\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgl6\" (UniqueName: \"kubernetes.io/projected/56a71be3-f920-4543-8aca-caaa777619e1-kube-api-access-5fgl6\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.142870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-os-release\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.142913    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.142961    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:17:58.642945674 +0000 UTC m=+3.128236949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.142979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-system-cni-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-binary-copy\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313ae437-78a7-4cab-afe5-8d18d65f4732-host-slash\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/313ae437-78a7-4cab-afe5-8d18d65f4732-iptables-alerter-script\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-system-cni-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04f0a9e2-9f73-4203-9631-e2e610dc272a-konnectivity-ca\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313ae437-78a7-4cab-afe5-8d18d65f4732-host-slash\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56a71be3-f920-4543-8aca-caaa777619e1-tmp-dir\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.143351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143195    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/071727e1-8d42-48ba-b5f7-9f9ef22d5781-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143835 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143835 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/313ae437-78a7-4cab-afe5-8d18d65f4732-iptables-alerter-script\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.143835 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/071727e1-8d42-48ba-b5f7-9f9ef22d5781-cni-binary-copy\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.143835 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.143797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04f0a9e2-9f73-4203-9631-e2e610dc272a-konnectivity-ca\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.145206 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.145183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04f0a9e2-9f73-4203-9631-e2e610dc272a-agent-certs\") pod \"konnectivity-agent-p6pqz\" (UID: \"04f0a9e2-9f73-4203-9631-e2e610dc272a\") " pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.151975 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.151859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48gr\" (UniqueName: \"kubernetes.io/projected/071727e1-8d42-48ba-b5f7-9f9ef22d5781-kube-api-access-s48gr\") pod \"multus-additional-cni-plugins-4bnl6\" (UID: \"071727e1-8d42-48ba-b5f7-9f9ef22d5781\") " pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.152573 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.152524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgl6\" (UniqueName: \"kubernetes.io/projected/56a71be3-f920-4543-8aca-caaa777619e1-kube-api-access-5fgl6\") pod \"node-resolver-pqqjj\" (UID: \"56a71be3-f920-4543-8aca-caaa777619e1\") " pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.153942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.153648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtn29\" (UniqueName: \"kubernetes.io/projected/313ae437-78a7-4cab-afe5-8d18d65f4732-kube-api-access-wtn29\") pod \"iptables-alerter-8cl8b\" (UID: \"313ae437-78a7-4cab-afe5-8d18d65f4732\") " pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.153942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.153675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhlz8\" (UniqueName: \"kubernetes.io/projected/5a795161-ed87-4547-94f9-1cf3a22652bf-kube-api-access-bhlz8\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.230691 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.230643    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:17:58.241120 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.241095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd"
Jul 10 00:17:58.242352 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:58.242242    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520a3cbc_2f67_48b8_bf8b_29fb329f2586.slice/crio-42dfa33535c8ef5f9e654ba7636aeb5eea98cbc49d0d4427bdf306466b2770bd WatchSource:0}: Error finding container 42dfa33535c8ef5f9e654ba7636aeb5eea98cbc49d0d4427bdf306466b2770bd: Status 404 returned error can't find the container with id 42dfa33535c8ef5f9e654ba7636aeb5eea98cbc49d0d4427bdf306466b2770bd
Jul 10 00:17:58.250668 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:58.250625    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be39260_f4a4_4991_b874_088a38bc9677.slice/crio-6466696add6878a4bf9efe229c88f8f4354d0a26d88d4fc04111127185329efc WatchSource:0}: Error finding container 6466696add6878a4bf9efe229c88f8f4354d0a26d88d4fc04111127185329efc: Status 404 returned error can't find the container with id 6466696add6878a4bf9efe229c88f8f4354d0a26d88d4fc04111127185329efc
Jul 10 00:17:58.250777 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.250752    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8m6b"
Jul 10 00:17:58.262262 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.262236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r97px"
Jul 10 00:17:58.270285 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.270244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdv5d"
Jul 10 00:17:58.278157 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.278103    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:17:58.287339 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.287312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pqqjj"
Jul 10 00:17:58.294195 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.294076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4bnl6"
Jul 10 00:17:58.302022 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.301995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8cl8b"
Jul 10 00:17:58.646850 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.646771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:58.646850 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.646807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:58.646850 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.646840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.646956    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.646970    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.646990    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.647000    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.647015    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:17:59.647001884 +0000 UTC m=+4.132293156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.646957    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.647045    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:17:59.647029874 +0000 UTC m=+4.132321148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:58.647183 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:58.647102    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:17:59.647084219 +0000 UTC m=+4.132375496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:58.905133 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.905052    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 00:17:58.959346 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.959304    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 00:12:58 +0000 UTC" deadline="2028-02-19 19:00:27.737533198 +0000 UTC"
Jul 10 00:17:58.959346 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:58.959343    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14154h42m28.778195141s"
Jul 10 00:17:59.185211 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.185129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:59.185366 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.185249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:59.185366 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.185259    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:17:59.185366 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.185281    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:59.185471 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.185383    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:17:59.185531 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.185478    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:17:59.192409 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.192376    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd" event={"ID":"4be39260-f4a4-4991-b874-088a38bc9677","Type":"ContainerStarted","Data":"6466696add6878a4bf9efe229c88f8f4354d0a26d88d4fc04111127185329efc"}
Jul 10 00:17:59.193749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.193725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"42dfa33535c8ef5f9e654ba7636aeb5eea98cbc49d0d4427bdf306466b2770bd"}
Jul 10 00:17:59.394686 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.394657    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be34c12_518a_4270_ad7d_890bb2a4c4f9.slice/crio-3d2a4a88edf113215f5823479cf3e3cf0a22c85edc676d1dabb3726f11934ff5 WatchSource:0}: Error finding container 3d2a4a88edf113215f5823479cf3e3cf0a22c85edc676d1dabb3726f11934ff5: Status 404 returned error can't find the container with id 3d2a4a88edf113215f5823479cf3e3cf0a22c85edc676d1dabb3726f11934ff5
Jul 10 00:17:59.413479 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.413448    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae6ac8e_6b2c_4d63_a3e3_19e0204c99c0.slice/crio-02c46aa21c0e8b05dfbdd8ede83c88762d5bd984d8a0becaf8600599ce61b097 WatchSource:0}: Error finding container 02c46aa21c0e8b05dfbdd8ede83c88762d5bd984d8a0becaf8600599ce61b097: Status 404 returned error can't find the container with id 02c46aa21c0e8b05dfbdd8ede83c88762d5bd984d8a0becaf8600599ce61b097
Jul 10 00:17:59.415062 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.415033    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d7be9b_40c7_4a9d_b928_95e629872529.slice/crio-40d5c5d695a0d5eeafdf6097f54e5089ce40f66314b23d5ed9eb7d1f0bd0b49a WatchSource:0}: Error finding container 40d5c5d695a0d5eeafdf6097f54e5089ce40f66314b23d5ed9eb7d1f0bd0b49a: Status 404 returned error can't find the container with id 40d5c5d695a0d5eeafdf6097f54e5089ce40f66314b23d5ed9eb7d1f0bd0b49a
Jul 10 00:17:59.416715 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.416565    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a71be3_f920_4543_8aca_caaa777619e1.slice/crio-5036e5cdc0790a9047ad9dc7755a76e99705b73654a419490b07e61ffc0c2e29 WatchSource:0}: Error finding container 5036e5cdc0790a9047ad9dc7755a76e99705b73654a419490b07e61ffc0c2e29: Status 404 returned error can't find the container with id 5036e5cdc0790a9047ad9dc7755a76e99705b73654a419490b07e61ffc0c2e29
Jul 10 00:17:59.419153 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.419106    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f0a9e2_9f73_4203_9631_e2e610dc272a.slice/crio-fe6b1b058c08b69b1cfe772ebe6b894218b2067e76b2fef4ffd8a901694e79e4 WatchSource:0}: Error finding container fe6b1b058c08b69b1cfe772ebe6b894218b2067e76b2fef4ffd8a901694e79e4: Status 404 returned error can't find the container with id fe6b1b058c08b69b1cfe772ebe6b894218b2067e76b2fef4ffd8a901694e79e4
Jul 10 00:17:59.419475 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:17:59.419407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313ae437_78a7_4cab_afe5_8d18d65f4732.slice/crio-41743c539b54464c7b0ae1a80b7677d8a282793815897fcbb6c30672c852409a WatchSource:0}: Error finding container 41743c539b54464c7b0ae1a80b7677d8a282793815897fcbb6c30672c852409a: Status 404 returned error can't find the container with id 41743c539b54464c7b0ae1a80b7677d8a282793815897fcbb6c30672c852409a
Jul 10 00:17:59.654071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.653782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:17:59.654071 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654054    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:59.654283 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.654119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:17:59.654283 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654141    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:18:01.65411865 +0000 UTC m=+6.139409927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:17:59.654283 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.654187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:17:59.654283 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654221    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:59.654561 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654317    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:18:01.654299128 +0000 UTC m=+6.139590415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:17:59.654561 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654345    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:17:59.654561 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654363    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:17:59.654561 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654376    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:59.654561 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:17:59.654419    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:18:01.65440505 +0000 UTC m=+6.139696359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:17:59.960128 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.960014    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 00:12:58 +0000 UTC" deadline="2028-04-07 08:16:20.484103342 +0000 UTC"
Jul 10 00:17:59.960128 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:17:59.960081    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15295h58m20.524026647s"
Jul 10 00:18:00.202008 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.201880    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerStarted","Data":"eb871713f0cc0975e56f1b72611b5e300821cda8f1ad2ce9425fed9e14b03336"}
Jul 10 00:18:00.207201 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.207151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cl8b" event={"ID":"313ae437-78a7-4cab-afe5-8d18d65f4732","Type":"ContainerStarted","Data":"41743c539b54464c7b0ae1a80b7677d8a282793815897fcbb6c30672c852409a"}
Jul 10 00:18:00.213590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.213542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdv5d" event={"ID":"19d7be9b-40c7-4a9d-b928-95e629872529","Type":"ContainerStarted","Data":"40d5c5d695a0d5eeafdf6097f54e5089ce40f66314b23d5ed9eb7d1f0bd0b49a"}
Jul 10 00:18:00.239285 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.239202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8m6b" event={"ID":"3be34c12-518a-4270-ad7d-890bb2a4c4f9","Type":"ContainerStarted","Data":"3d2a4a88edf113215f5823479cf3e3cf0a22c85edc676d1dabb3726f11934ff5"}
Jul 10 00:18:00.260447 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.260403    2575 generic.go:356] "Generic (PLEG): container finished" podID="dea13881fc04fc1dd88d8f5520e282e2" containerID="612d3887b557e205d6158302078177a416bc129acff9e2175b6586a0e681cf67" exitCode=0
Jul 10 00:18:00.260667 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.260503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal" event={"ID":"dea13881fc04fc1dd88d8f5520e282e2","Type":"ContainerDied","Data":"612d3887b557e205d6158302078177a416bc129acff9e2175b6586a0e681cf67"}
Jul 10 00:18:00.273815 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.273730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p6pqz" event={"ID":"04f0a9e2-9f73-4203-9631-e2e610dc272a","Type":"ContainerStarted","Data":"fe6b1b058c08b69b1cfe772ebe6b894218b2067e76b2fef4ffd8a901694e79e4"}
Jul 10 00:18:00.283945 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.283875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqqjj" event={"ID":"56a71be3-f920-4543-8aca-caaa777619e1","Type":"ContainerStarted","Data":"5036e5cdc0790a9047ad9dc7755a76e99705b73654a419490b07e61ffc0c2e29"}
Jul 10 00:18:00.286245 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.286211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r97px" event={"ID":"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0","Type":"ContainerStarted","Data":"02c46aa21c0e8b05dfbdd8ede83c88762d5bd984d8a0becaf8600599ce61b097"}
Jul 10 00:18:00.303939 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:00.303676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal" event={"ID":"d58ff4672371e2d87fef8bb390ed631a","Type":"ContainerStarted","Data":"ebfb171ef9a4b7ff37d6f0456dff7cb7a30b304588d7ba95edd4306d1e3d87d6"}
Jul 10 00:18:01.185820 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.185785    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:01.186323 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.185946    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:01.186410 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.186380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:01.186538 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.186510    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:01.186615 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.186588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:01.186689 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.186669    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:01.321583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.321541    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal" event={"ID":"dea13881fc04fc1dd88d8f5520e282e2","Type":"ContainerStarted","Data":"143ecb013b16dd66cecdfe502af29ac4877784d140c89c487d7fb1ccd099f357"}
Jul 10 00:18:01.337098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.337028    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-199.ec2.internal" podStartSLOduration=4.337004375 podStartE2EDuration="4.337004375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:00.318280489 +0000 UTC m=+4.803571785" watchObservedRunningTime="2026-07-10 00:18:01.337004375 +0000 UTC m=+5.822295671"
Jul 10 00:18:01.673903 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.673810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:01.673903 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.673880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:01.674157 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:01.673935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:01.674157 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674071    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:01.674157 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674139    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:18:05.67411753 +0000 UTC m=+10.159408823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:01.674326 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674220    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:01.674326 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674257    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:18:05.674244963 +0000 UTC m=+10.159536235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:01.674436 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674347    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:18:01.674436 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674363    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:18:01.674436 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674377    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:01.674436 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:01.674415    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:18:05.674402641 +0000 UTC m=+10.159693922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:03.185129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:03.185171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:03.185284    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:03.185344    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:03.185434    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:03.185715 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:03.185528    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:05.185233 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.185200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:05.185684 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.185323    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:05.185684 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.185668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:05.185803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.185699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:05.185803 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.185786    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:05.185933 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.185903    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:05.707343 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.707170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:05.707343 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.707248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:05.707343 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:05.707281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:05.707343 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707330    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707403    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:18:13.70738293 +0000 UTC m=+18.192674199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707414    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707436    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707448    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707494    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:18:13.707479358 +0000 UTC m=+18.192770635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707552    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:05.707726 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:05.707587    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:18:13.707574029 +0000 UTC m=+18.192865316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:07.185263 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:07.185234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:07.185595 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:07.185263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:07.185595 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:07.185234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:07.185595 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:07.185348    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:07.185595 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:07.185456    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:07.185595 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:07.185533    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:09.185328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:09.185248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:09.185328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:09.185282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:09.185857 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:09.185378    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:09.185922 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:09.185873    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:09.185974 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:09.185930    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:09.186032 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:09.186014    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:10.341707 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.341615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r97px" event={"ID":"6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0","Type":"ContainerStarted","Data":"36cd62f61f38393443acb7312bfe1a600b9da04a16711521f2c69afbe5590846"}
Jul 10 00:18:10.343263 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.343238    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd" event={"ID":"4be39260-f4a4-4991-b874-088a38bc9677","Type":"ContainerStarted","Data":"8e9d3eb6346cf4e6fc02fd754ace2f32f5acb813f4fb3b67a0292c88a1bd0081"}
Jul 10 00:18:10.344866 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.344818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerStarted","Data":"c46ef0aedb00d41463f3053a378257573d409843f772d2de03479dde030c2d3a"}
Jul 10 00:18:10.346370 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.346346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p6pqz" event={"ID":"04f0a9e2-9f73-4203-9631-e2e610dc272a","Type":"ContainerStarted","Data":"3b2a58a78ac603c8bf771f370f6f4d5242695bfc60af27f0e5a590e75da9c84f"}
Jul 10 00:18:10.347757 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.347732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pqqjj" event={"ID":"56a71be3-f920-4543-8aca-caaa777619e1","Type":"ContainerStarted","Data":"51568db4035f04d8a5228c0c9672c61ae8b6c50921dd8bcc0cbb08cc4007b5a9"}
Jul 10 00:18:10.355406 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.355369    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r97px" podStartSLOduration=4.022599421 podStartE2EDuration="14.35535442s" totalImagesPullingTime="10.332754999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:10.355038774 +0000 UTC m=+14.840330065" watchObservedRunningTime="2026-07-10 00:18:10.35535442 +0000 UTC m=+14.840645712"
Jul 10 00:18:10.355601 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.355576    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-199.ec2.internal" podStartSLOduration=13.355568983 podStartE2EDuration="13.355568983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:01.338069479 +0000 UTC m=+5.823360775" watchObservedRunningTime="2026-07-10 00:18:10.355568983 +0000 UTC m=+14.840860273"
Jul 10 00:18:10.371521 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.371476    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pqqjj" podStartSLOduration=4.04205807 podStartE2EDuration="14.371459786s" totalImagesPullingTime="10.329401716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:10.371362829 +0000 UTC m=+14.856654124" watchObservedRunningTime="2026-07-10 00:18:10.371459786 +0000 UTC m=+14.856751076"
Jul 10 00:18:10.386111 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:10.386063    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p6pqz" podStartSLOduration=4.059116305 podStartE2EDuration="14.386046295s" totalImagesPullingTime="10.32692999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:10.385254596 +0000 UTC m=+14.870545889" watchObservedRunningTime="2026-07-10 00:18:10.386046295 +0000 UTC m=+14.871337587"
Jul 10 00:18:11.186066 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:11.186023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:11.186260 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:11.186037    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:11.186260 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:11.186149    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:11.186260 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:11.186152    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:11.186260 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:11.186245    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:11.186483 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:11.186308    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:12.354285 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:12.354056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8cl8b" event={"ID":"313ae437-78a7-4cab-afe5-8d18d65f4732","Type":"ContainerStarted","Data":"28feaaf1c862e07bde974db4f4e7cdffd0e0d52543725dca1e3ab86876d1441a"}
Jul 10 00:18:12.369223 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:12.369161    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8cl8b" podStartSLOduration=6.024459354 podStartE2EDuration="16.369144715s" totalImagesPullingTime="10.344685361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:12.368487326 +0000 UTC m=+16.853778618" watchObservedRunningTime="2026-07-10 00:18:12.369144715 +0000 UTC m=+16.854436006"
Jul 10 00:18:13.185561 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.185522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:13.185760 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.185522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:13.185760 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.185650    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:13.185760 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.185743    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:13.185919 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.185522    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:13.185919 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.185859    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:13.771154 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.771113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.771236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771251    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.771288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771334    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:18:29.77131248 +0000 UTC m=+34.256603768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771363    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771382    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771395    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771400    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771439    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:18:29.771425169 +0000 UTC m=+34.256716447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:13.771591 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:13.771461    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:18:29.771448618 +0000 UTC m=+34.256739891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:13.949818 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:13.949789    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:18:14.234861 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:14.234774    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:18:14.235399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:14.235379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:18:14.359456 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:14.359425    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p6pqz"
Jul 10 00:18:15.185810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:15.185770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:15.186533 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:15.185770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:15.186533 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:15.185914    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:15.186533 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:15.185772    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:15.186533 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:15.186002    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:15.186533 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:15.186053    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:15.362172 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:15.362133    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="c46ef0aedb00d41463f3053a378257573d409843f772d2de03479dde030c2d3a" exitCode=0
Jul 10 00:18:15.362360 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:15.362224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"c46ef0aedb00d41463f3053a378257573d409843f772d2de03479dde030c2d3a"}
Jul 10 00:18:17.185405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:17.185368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:17.185977 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:17.185387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:17.185977 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:17.185508    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:17.185977 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:17.185531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:17.185977 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:17.185645    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:17.185977 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:17.185747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:18.481736 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:18.481415    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 00:18:19.000193 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:18.999816    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T00:18:18.481616561Z","UUID":"d87a62b7-acfe-492a-8a0e-8a0f85865306","Handler":null,"Name":"","Endpoint":""}
Jul 10 00:18:19.001573 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.001544    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 00:18:19.001713 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.001591    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 00:18:19.186037 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.185990    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:19.186037 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.186016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:19.186037 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.186009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:19.186305 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:19.186222    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:19.186485 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:19.186446    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:19.186619 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:19.186530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:19.373676 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.373594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd" event={"ID":"4be39260-f4a4-4991-b874-088a38bc9677","Type":"ContainerStarted","Data":"083bf65687a456eab5227411529d83181f9225ccfbe1f37525742dd44453e06a"}
Jul 10 00:18:19.375219 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.375188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdv5d" event={"ID":"19d7be9b-40c7-4a9d-b928-95e629872529","Type":"ContainerStarted","Data":"bc729a5f58369f549bb9ae6d2f10c651b6dd5fe3b8e615bbca5a014f7a94f67c"}
Jul 10 00:18:19.376863 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.376820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8m6b" event={"ID":"3be34c12-518a-4270-ad7d-890bb2a4c4f9","Type":"ContainerStarted","Data":"70838351c828841d1749adcf9887f367587b2281f0418e4d665babdc72b5aff6"}
Jul 10 00:18:19.381022 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.380984    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:18:19.383537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383509    2575 generic.go:356] "Generic (PLEG): container finished" podID="520a3cbc-2f67-48b8-bf8b-29fb329f2586" containerID="9002619a7b063c305468450c230e18e6642797dedba5bea39f0d6d1fbb0c336c" exitCode=1
Jul 10 00:18:19.383647 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"3b8cfa83c38a22ad6d1583ff964e612f33a16128843560e027c60c025be610f0"}
Jul 10 00:18:19.383647 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"fb1dd4ee5957c92293e7b7273c2d3eec36dfa3b9fe629ed6f378292b50619f72"}
Jul 10 00:18:19.383731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"3c49729d7343e991a301a1236c86c3c04f3c40e690ab718fcdfb14a4ed5320ec"}
Jul 10 00:18:19.383766 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"826ded433fdff942c0f6af7ea553263447e43b54042872bd994f2cd2d7a6de28"}
Jul 10 00:18:19.383805 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383787    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerDied","Data":"9002619a7b063c305468450c230e18e6642797dedba5bea39f0d6d1fbb0c336c"}
Jul 10 00:18:19.383856 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.383826    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"a456d9a024e8481d7f60ef0b783a6e123e6d62197b1b238aaff6c7de4ac004a7"}
Jul 10 00:18:19.392503 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.392464    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdv5d" podStartSLOduration=4.4093093 podStartE2EDuration="23.392452835s" totalImagesPullingTime="18.983143535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:19.392286475 +0000 UTC m=+23.877577767" watchObservedRunningTime="2026-07-10 00:18:19.392452835 +0000 UTC m=+23.877744125"
Jul 10 00:18:19.407208 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:19.407165    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8m6b" podStartSLOduration=12.717577405 podStartE2EDuration="23.407152926s" totalImagesPullingTime="10.689575521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:19.406936055 +0000 UTC m=+23.892227347" watchObservedRunningTime="2026-07-10 00:18:19.407152926 +0000 UTC m=+23.892444269"
Jul 10 00:18:20.388519 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:20.388479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd" event={"ID":"4be39260-f4a4-4991-b874-088a38bc9677","Type":"ContainerStarted","Data":"2ccd6f0aecc5c753409aa4962a5da4df0672186102575cb7cb59fa20028ac750"}
Jul 10 00:18:20.407105 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:20.407055    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xvwkd" podStartSLOduration=3.449128865 podStartE2EDuration="24.407039218s" totalImagesPullingTime="20.957910353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:20.406507432 +0000 UTC m=+24.891798725" watchObservedRunningTime="2026-07-10 00:18:20.407039218 +0000 UTC m=+24.892330509"
Jul 10 00:18:21.185579 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:21.185495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:21.185579 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:21.185539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:21.185579 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:21.185495    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:21.185903 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:21.185635    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:21.185903 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:21.185696    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:21.185903 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:21.185772    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:21.394992 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:21.394962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:18:21.395454 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:21.395416    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"4dd21f46bbe8113ee804859298bd7269ac686539afd6cd80bcf48df41c6fa0a8"}
Jul 10 00:18:23.186028 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.185998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:23.186617 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.186032    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:23.186617 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.185999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:23.186617 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:23.186111    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:23.186617 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:23.186192    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:23.186617 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:23.186308    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:23.403621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.403550    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:18:23.403969 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.403934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"ce129b8c608371e99528d2c4be63bb44cb28d136a09a2d5ab36c05da0832b785"}
Jul 10 00:18:23.404196 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.404177    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:18:23.404292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.404273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:18:23.404366 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.404331    2575 scope.go:117] "RemoveContainer" containerID="9002619a7b063c305468450c230e18e6642797dedba5bea39f0d6d1fbb0c336c"
Jul 10 00:18:23.422660 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:23.422566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:18:24.411450 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:24.411248    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:18:24.412046 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:24.411870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" event={"ID":"520a3cbc-2f67-48b8-bf8b-29fb329f2586","Type":"ContainerStarted","Data":"43367a311cfac6370af86d73eedec522d6e89c1cb96de07b68b7f4a9a64d148d"}
Jul 10 00:18:24.412120 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:24.412102    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:18:24.429853 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:24.429811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:18:24.440824 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:24.440739    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x" podStartSLOduration=8.333879729 podStartE2EDuration="28.440717119s" totalImagesPullingTime="20.10683739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:24.438985458 +0000 UTC m=+28.924276752" watchObservedRunningTime="2026-07-10 00:18:24.440717119 +0000 UTC m=+28.926008413"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.186393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.186433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.186400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.186522    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.186595    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:25.186676 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.186660    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:25.415869 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.415824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerStarted","Data":"58e3d3ac15fb269a5f932c9869faca9999a144356516a3afc427286c931394ff"}
Jul 10 00:18:25.476239 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.476158    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhs8w"]
Jul 10 00:18:25.476368 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.476292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:25.476436 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.476411    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:25.476933 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.476901    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czjs4"]
Jul 10 00:18:25.477029 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.476980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:25.477083 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.477067    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:25.478294 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.478275    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q987s"]
Jul 10 00:18:25.478357 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:25.478338    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:25.478416 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:25.478400    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:26.419716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:26.419680    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="58e3d3ac15fb269a5f932c9869faca9999a144356516a3afc427286c931394ff" exitCode=0
Jul 10 00:18:26.420097 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:26.419757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"58e3d3ac15fb269a5f932c9869faca9999a144356516a3afc427286c931394ff"}
Jul 10 00:18:27.185989 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:27.185956    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:27.186151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:27.185960    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:27.186151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:27.186086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:27.186151 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:27.186066    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:27.186261 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:27.186223    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:27.186396 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:27.186368    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:27.425562 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:27.425301    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="a5ba1c01121c31f3a685f6333182f856f5172890713171c718cf0b65748dfa3b" exitCode=0
Jul 10 00:18:27.425562 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:27.425380    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"a5ba1c01121c31f3a685f6333182f856f5172890713171c718cf0b65748dfa3b"}
Jul 10 00:18:28.430342 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:28.430314    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="f62201cf165da5e9c687ee1eb98dd75e3ae8be51f54e12be2ac0abeb4c2f2bdf" exitCode=0
Jul 10 00:18:28.430913 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:28.430352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"f62201cf165da5e9c687ee1eb98dd75e3ae8be51f54e12be2ac0abeb4c2f2bdf"}
Jul 10 00:18:29.185163 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.185108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:29.185163 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.185155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:29.185382 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.185225    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:29.185382 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.185239    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:29.185382 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.185332    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:29.185541 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.185462    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:29.796812 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.796777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.796852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:29.796881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.796941    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.796989    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797004    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797008    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:19:01.796989291 +0000 UTC m=+66.282280574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797016    2575 projected.go:196] Error preparing data for projected volume kube-api-access-f428r for pod openshift-network-diagnostics/network-check-target-q987s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797023    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797051    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r podName:79b197c1-fe4d-4e1d-b7cb-2fc62daffe16 nodeName:}" failed. No retries permitted until 2026-07-10 00:19:01.797041382 +0000 UTC m=+66.282332651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f428r" (UniqueName: "kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r") pod "network-check-target-q987s" (UID: "79b197c1-fe4d-4e1d-b7cb-2fc62daffe16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 00:18:29.797292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:29.797082    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret podName:940c64ff-1336-490c-8ce0-42f2ad0fdedb nodeName:}" failed. No retries permitted until 2026-07-10 00:19:01.79706522 +0000 UTC m=+66.282356505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret") pod "global-pull-secret-syncer-czjs4" (UID: "940c64ff-1336-490c-8ce0-42f2ad0fdedb") : object "kube-system"/"original-pull-secret" not registered
Jul 10 00:18:31.185461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.185429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:31.186070 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.185429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:31.186070 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:31.185563    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:18:31.186070 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.185447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:31.186070 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:31.185687    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q987s" podUID="79b197c1-fe4d-4e1d-b7cb-2fc62daffe16"
Jul 10 00:18:31.186070 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:31.185720    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czjs4" podUID="940c64ff-1336-490c-8ce0-42f2ad0fdedb"
Jul 10 00:18:31.308945 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.308913    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-199.ec2.internal" event="NodeReady"
Jul 10 00:18:31.309192 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.309067    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 00:18:31.350662 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.350620    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hw6tv"]
Jul 10 00:18:31.357257 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.357234    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clh6w"]
Jul 10 00:18:31.357399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.357373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.359951 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.359929    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 00:18:31.360071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.359996    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p75jv\""
Jul 10 00:18:31.360126 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.360074    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 00:18:31.362556 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.362506    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.363093 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.363068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hw6tv"]
Jul 10 00:18:31.366264 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.365330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 00:18:31.366264 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.365417    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ffdj8\""
Jul 10 00:18:31.366264 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.366011    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clh6w"]
Jul 10 00:18:31.367089 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.367000    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 00:18:31.367089 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.367053    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 00:18:31.508960 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.508879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b4ee644-afb1-49d9-87a7-d49900f2a54d-cert\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.508960 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.508949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rr4\" (UniqueName: \"kubernetes.io/projected/16fdeb06-489c-4076-b5ce-ee9bb619611b-kube-api-access-f8rr4\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.509161 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.508985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fdeb06-489c-4076-b5ce-ee9bb619611b-tmp-dir\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.509161 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.509070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16fdeb06-489c-4076-b5ce-ee9bb619611b-config-volume\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.509857 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.509414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.509857 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.509477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd86b\" (UniqueName: \"kubernetes.io/projected/4b4ee644-afb1-49d9-87a7-d49900f2a54d-kube-api-access-hd86b\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.610235 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rr4\" (UniqueName: \"kubernetes.io/projected/16fdeb06-489c-4076-b5ce-ee9bb619611b-kube-api-access-f8rr4\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.610423 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fdeb06-489c-4076-b5ce-ee9bb619611b-tmp-dir\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.610423 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16fdeb06-489c-4076-b5ce-ee9bb619611b-config-volume\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.610423 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.610595 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:31.610431    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:31.610595 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd86b\" (UniqueName: \"kubernetes.io/projected/4b4ee644-afb1-49d9-87a7-d49900f2a54d-kube-api-access-hd86b\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.610595 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:31.610519    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:18:32.110498974 +0000 UTC m=+36.595790467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:31.610595 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b4ee644-afb1-49d9-87a7-d49900f2a54d-cert\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.610793 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.610668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16fdeb06-489c-4076-b5ce-ee9bb619611b-tmp-dir\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.611170 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.611149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16fdeb06-489c-4076-b5ce-ee9bb619611b-config-volume\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.615155 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.615121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b4ee644-afb1-49d9-87a7-d49900f2a54d-cert\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.618894 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.618869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rr4\" (UniqueName: \"kubernetes.io/projected/16fdeb06-489c-4076-b5ce-ee9bb619611b-kube-api-access-f8rr4\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:31.619170 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.619144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd86b\" (UniqueName: \"kubernetes.io/projected/4b4ee644-afb1-49d9-87a7-d49900f2a54d-kube-api-access-hd86b\") pod \"ingress-canary-clh6w\" (UID: \"4b4ee644-afb1-49d9-87a7-d49900f2a54d\") " pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:31.677251 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:31.677218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clh6w"
Jul 10 00:18:32.114449 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:32.114415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:32.114613 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:32.114575    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:32.114660 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:32.114651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:18:33.11463149 +0000 UTC m=+37.599922759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:32.570171 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:32.569960    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clh6w"]
Jul 10 00:18:32.629840 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:18:32.629809    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4ee644_afb1_49d9_87a7_d49900f2a54d.slice/crio-eeda5a2e1aec9c6389c4c05bf16f7bcc74d0a5d536f2ec1564862b5da67b9f66 WatchSource:0}: Error finding container eeda5a2e1aec9c6389c4c05bf16f7bcc74d0a5d536f2ec1564862b5da67b9f66: Status 404 returned error can't find the container with id eeda5a2e1aec9c6389c4c05bf16f7bcc74d0a5d536f2ec1564862b5da67b9f66
Jul 10 00:18:33.122770 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.122680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:33.122950 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:33.122828    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:33.122950 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:33.122922    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:18:35.122901599 +0000 UTC m=+39.608192871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:33.185847 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.185801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:18:33.185993 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.185801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:18:33.185993 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.185937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:18:33.189909 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189874    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 00:18:33.190023 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189934    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 00:18:33.190023 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189941    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7p4r9\""
Jul 10 00:18:33.190023 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189999    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 00:18:33.190023 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189939    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 00:18:33.190241 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.189941    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7wp6\""
Jul 10 00:18:33.444339 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.444304    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="0b96d16004d366e9db960924a00ab3f3710105d282d6b392b22880ffebe5a297" exitCode=0
Jul 10 00:18:33.444496 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.444361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"0b96d16004d366e9db960924a00ab3f3710105d282d6b392b22880ffebe5a297"}
Jul 10 00:18:33.445552 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:33.445529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clh6w" event={"ID":"4b4ee644-afb1-49d9-87a7-d49900f2a54d","Type":"ContainerStarted","Data":"eeda5a2e1aec9c6389c4c05bf16f7bcc74d0a5d536f2ec1564862b5da67b9f66"}
Jul 10 00:18:34.451349 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:34.451317    2575 generic.go:356] "Generic (PLEG): container finished" podID="071727e1-8d42-48ba-b5f7-9f9ef22d5781" containerID="6d990c321dcada0f5b1e58a7c8d14467adb36b209bf6090b02b07dbfcf21bf79" exitCode=0
Jul 10 00:18:34.451858 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:34.451377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerDied","Data":"6d990c321dcada0f5b1e58a7c8d14467adb36b209bf6090b02b07dbfcf21bf79"}
Jul 10 00:18:35.138552 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:35.138462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:35.138703 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:35.138613    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:35.138703 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:35.138675    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:18:39.138658468 +0000 UTC m=+43.623949737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:35.456549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:35.456513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" event={"ID":"071727e1-8d42-48ba-b5f7-9f9ef22d5781","Type":"ContainerStarted","Data":"58c635eb9265a00c6ab2440d3a58ac9f8175435c40127df51ee45ff10e9d48aa"}
Jul 10 00:18:35.478911 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:35.478866    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4bnl6" podStartSLOduration=13.648143877 podStartE2EDuration="39.478829602s" totalImagesPullingTime="25.830685725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:35.477163449 +0000 UTC m=+39.962454750" watchObservedRunningTime="2026-07-10 00:18:35.478829602 +0000 UTC m=+39.964120894"
Jul 10 00:18:36.460713 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:36.460530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clh6w" event={"ID":"4b4ee644-afb1-49d9-87a7-d49900f2a54d","Type":"ContainerStarted","Data":"b724388c10b67f1284836cdb3fed68cffa680e62434dc9757b4684785cfd021c"}
Jul 10 00:18:36.473960 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:36.473915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clh6w" podStartSLOduration=2.457282535 podStartE2EDuration="5.473899529s" totalImagesPullingTime="3.016616994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:18:36.473647249 +0000 UTC m=+40.958938541" watchObservedRunningTime="2026-07-10 00:18:36.473899529 +0000 UTC m=+40.959190819"
Jul 10 00:18:39.165917 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:39.165872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:39.166294 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:39.165995    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:39.166294 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:39.166047    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:18:47.16603463 +0000 UTC m=+51.651325902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:47.220811 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:47.220760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:18:47.221330 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:47.220928    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:18:47.221330 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:18:47.220994    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:19:03.220978326 +0000 UTC m=+67.706269598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:18:56.440011 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:18:56.439979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zth6x"
Jul 10 00:19:01.821482 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.821447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:19:01.821482 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.821485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:19:01.822009 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.821523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:19:01.824330 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.824310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 00:19:01.824440 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.824422    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 00:19:01.824580 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.824564    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 00:19:01.832696 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:01.832678    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 00:19:01.832756 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:01.832747    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:20:05.832730977 +0000 UTC m=+130.318022249 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : secret "metrics-daemon-secret" not found
Jul 10 00:19:01.834862 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.834829    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 00:19:01.836374 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.836347    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/940c64ff-1336-490c-8ce0-42f2ad0fdedb-original-pull-secret\") pod \"global-pull-secret-syncer-czjs4\" (UID: \"940c64ff-1336-490c-8ce0-42f2ad0fdedb\") " pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:19:01.845013 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.844993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f428r\" (UniqueName: \"kubernetes.io/projected/79b197c1-fe4d-4e1d-b7cb-2fc62daffe16-kube-api-access-f428r\") pod \"network-check-target-q987s\" (UID: \"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16\") " pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:19:01.995643 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:01.995603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czjs4"
Jul 10 00:19:02.003351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.003326    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7p4r9\""
Jul 10 00:19:02.011615 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.011591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:19:02.141351 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.141319    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czjs4"]
Jul 10 00:19:02.145478 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:19:02.145446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940c64ff_1336_490c_8ce0_42f2ad0fdedb.slice/crio-885b232cf787d3e5a32522068879fce4de9d571f8d903acf194b2c5ba6d1d804 WatchSource:0}: Error finding container 885b232cf787d3e5a32522068879fce4de9d571f8d903acf194b2c5ba6d1d804: Status 404 returned error can't find the container with id 885b232cf787d3e5a32522068879fce4de9d571f8d903acf194b2c5ba6d1d804
Jul 10 00:19:02.155134 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.155112    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q987s"]
Jul 10 00:19:02.159358 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:19:02.159331    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b197c1_fe4d_4e1d_b7cb_2fc62daffe16.slice/crio-24077577d877b20117190c118e5e5ebc6ea054524506fd1d6fc6635c4b9f6432 WatchSource:0}: Error finding container 24077577d877b20117190c118e5e5ebc6ea054524506fd1d6fc6635c4b9f6432: Status 404 returned error can't find the container with id 24077577d877b20117190c118e5e5ebc6ea054524506fd1d6fc6635c4b9f6432
Jul 10 00:19:02.519856 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.519805    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czjs4" event={"ID":"940c64ff-1336-490c-8ce0-42f2ad0fdedb","Type":"ContainerStarted","Data":"885b232cf787d3e5a32522068879fce4de9d571f8d903acf194b2c5ba6d1d804"}
Jul 10 00:19:02.520868 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:02.520845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q987s" event={"ID":"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16","Type":"ContainerStarted","Data":"24077577d877b20117190c118e5e5ebc6ea054524506fd1d6fc6635c4b9f6432"}
Jul 10 00:19:03.233328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:03.233293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:19:03.233767 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:03.233498    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:19:03.233767 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:03.233591    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:19:35.233559795 +0000 UTC m=+99.718851069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:19:07.536583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:07.536539    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q987s" event={"ID":"79b197c1-fe4d-4e1d-b7cb-2fc62daffe16","Type":"ContainerStarted","Data":"0722cc296f571ea2328407f55deb7863f4f7d9561246e8dc1fda364023fe43b7"}
Jul 10 00:19:07.537089 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:07.536658    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:19:07.537857 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:07.537825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czjs4" event={"ID":"940c64ff-1336-490c-8ce0-42f2ad0fdedb","Type":"ContainerStarted","Data":"adacaf467b40a69481e6035702b4e34520bf62c238bd08fae9b17ab2ba012721"}
Jul 10 00:19:07.551317 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:07.551274    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q987s" podStartSLOduration=66.741778145 podStartE2EDuration="1m11.551258767s" totalImagesPullingTime="4.809480622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:19:07.5512585 +0000 UTC m=+72.036549792" watchObservedRunningTime="2026-07-10 00:19:07.551258767 +0000 UTC m=+72.036550059"
Jul 10 00:19:07.564770 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:07.564724    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-czjs4" podStartSLOduration=66.737163637 podStartE2EDuration="1m11.564707412s" totalImagesPullingTime="4.827543775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:19:07.564553966 +0000 UTC m=+72.049845257" watchObservedRunningTime="2026-07-10 00:19:07.564707412 +0000 UTC m=+72.049998705"
Jul 10 00:19:08.926003 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.925965    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"]
Jul 10 00:19:08.927671 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.927654    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:08.930098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.930077    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 00:19:08.931328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.931310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 00:19:08.931396 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.931341    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 00:19:08.931396 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.931356    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 00:19:08.938434 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.938414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"]
Jul 10 00:19:08.977752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.977716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a5820-4c5e-4de6-82a4-191edd9aabab-tmp\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:08.977937 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.977781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e85a5820-4c5e-4de6-82a4-191edd9aabab-klusterlet-config\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:08.977937 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:08.977827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkdr\" (UniqueName: \"kubernetes.io/projected/e85a5820-4c5e-4de6-82a4-191edd9aabab-kube-api-access-hkkdr\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.078943 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.078905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e85a5820-4c5e-4de6-82a4-191edd9aabab-klusterlet-config\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.079126 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.078959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkdr\" (UniqueName: \"kubernetes.io/projected/e85a5820-4c5e-4de6-82a4-191edd9aabab-kube-api-access-hkkdr\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.079126 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.079002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a5820-4c5e-4de6-82a4-191edd9aabab-tmp\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.079443 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.079421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a5820-4c5e-4de6-82a4-191edd9aabab-tmp\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.081275 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.081258    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e85a5820-4c5e-4de6-82a4-191edd9aabab-klusterlet-config\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.087115 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.087082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkdr\" (UniqueName: \"kubernetes.io/projected/e85a5820-4c5e-4de6-82a4-191edd9aabab-kube-api-access-hkkdr\") pod \"klusterlet-addon-workmgr-66b87bd9cc-gr9c8\" (UID: \"e85a5820-4c5e-4de6-82a4-191edd9aabab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.236799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.236717    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:09.357108 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.357081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"]
Jul 10 00:19:09.359655 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:19:09.359627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85a5820_4c5e_4de6_82a4_191edd9aabab.slice/crio-1cedff361d6a0983b997233bc9df8d052c5fa02346ce124193e6ee19bfee58ac WatchSource:0}: Error finding container 1cedff361d6a0983b997233bc9df8d052c5fa02346ce124193e6ee19bfee58ac: Status 404 returned error can't find the container with id 1cedff361d6a0983b997233bc9df8d052c5fa02346ce124193e6ee19bfee58ac
Jul 10 00:19:09.543924 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:09.543822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" event={"ID":"e85a5820-4c5e-4de6-82a4-191edd9aabab","Type":"ContainerStarted","Data":"1cedff361d6a0983b997233bc9df8d052c5fa02346ce124193e6ee19bfee58ac"}
Jul 10 00:19:13.556153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:13.556118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" event={"ID":"e85a5820-4c5e-4de6-82a4-191edd9aabab","Type":"ContainerStarted","Data":"c45e368f8f3ea3524dd98217e5caac34258398ffe7727515c0759880fdb07c76"}
Jul 10 00:19:13.556599 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:13.556328    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:13.558480 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:13.558448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:19:13.573962 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:13.573913    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" podStartSLOduration=1.893238986 podStartE2EDuration="5.573898826s" totalImagesPullingTime="3.68065984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:19:13.572654033 +0000 UTC m=+78.057945328" watchObservedRunningTime="2026-07-10 00:19:13.573898826 +0000 UTC m=+78.059190118"
Jul 10 00:19:35.259588 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:35.259548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:19:35.260029 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:35.259758    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:19:35.260029 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:19:35.259861    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:20:39.259820083 +0000 UTC m=+163.745111353 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:19:38.542999 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:19:38.542968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q987s"
Jul 10 00:20:05.868334 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:20:05.868294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:20:05.868902 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:05.868419    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 00:20:05.868902 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:05.868505    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs podName:5a795161-ed87-4547-94f9-1cf3a22652bf nodeName:}" failed. No retries permitted until 2026-07-10 00:22:07.868483441 +0000 UTC m=+252.353774725 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs") pod "network-metrics-daemon-qhs8w" (UID: "5a795161-ed87-4547-94f9-1cf3a22652bf") : secret "metrics-daemon-secret" not found
Jul 10 00:20:34.370445 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:34.370399    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hw6tv" podUID="16fdeb06-489c-4076-b5ce-ee9bb619611b"
Jul 10 00:20:34.751953 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:20:34.751920    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:20:36.205607 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:36.205569    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qhs8w" podUID="5a795161-ed87-4547-94f9-1cf3a22652bf"
Jul 10 00:20:39.290934 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:20:39.290899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:20:39.291292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:39.290995    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 00:20:39.291292 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:20:39.291046    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls podName:16fdeb06-489c-4076-b5ce-ee9bb619611b nodeName:}" failed. No retries permitted until 2026-07-10 00:22:41.291031764 +0000 UTC m=+285.776323033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls") pod "dns-default-hw6tv" (UID: "16fdeb06-489c-4076-b5ce-ee9bb619611b") : secret "dns-default-metrics-tls" not found
Jul 10 00:20:48.185278 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:20:48.185200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:21:13.557156 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:13.557104    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" podUID="e85a5820-4c5e-4de6-82a4-191edd9aabab" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 10 00:21:13.844415 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:13.844336    2575 generic.go:356] "Generic (PLEG): container finished" podID="e85a5820-4c5e-4de6-82a4-191edd9aabab" containerID="c45e368f8f3ea3524dd98217e5caac34258398ffe7727515c0759880fdb07c76" exitCode=1
Jul 10 00:21:13.844548 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:13.844410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" event={"ID":"e85a5820-4c5e-4de6-82a4-191edd9aabab","Type":"ContainerDied","Data":"c45e368f8f3ea3524dd98217e5caac34258398ffe7727515c0759880fdb07c76"}
Jul 10 00:21:13.844762 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:13.844743    2575 scope.go:117] "RemoveContainer" containerID="c45e368f8f3ea3524dd98217e5caac34258398ffe7727515c0759880fdb07c76"
Jul 10 00:21:14.849614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:14.849580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8" event={"ID":"e85a5820-4c5e-4de6-82a4-191edd9aabab","Type":"ContainerStarted","Data":"5b56a1b81d5d78d71df099a3d72743c91404649b3695ee72611cd927b507d1ca"}
Jul 10 00:21:14.850012 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:14.849822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:21:14.850480 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:14.850465    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66b87bd9cc-gr9c8"
Jul 10 00:21:28.056016 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.055982    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"]
Jul 10 00:21:28.058829 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.058811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"
Jul 10 00:21:28.061594 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.061570    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-62t59\""
Jul 10 00:21:28.063429 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.063410    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:21:28.069015 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.068996    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.071577 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.071554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 00:21:28.071685 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.071604    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tf97q\""
Jul 10 00:21:28.071857 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.071827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 00:21:28.072222 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.072205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 00:21:28.076673 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.076652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"]
Jul 10 00:21:28.078066 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.078047    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 00:21:28.085517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.085496    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:21:28.122669 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.122669 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.122881 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.122881 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.122881 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.122881 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fzc5\" (UniqueName: \"kubernetes.io/projected/5d86ddf4-d894-4ccf-aada-d7edb14dc39d-kube-api-access-7fzc5\") pod \"network-check-source-869dcfcdcd-9zjzc\" (UID: \"5d86ddf4-d894-4ccf-aada-d7edb14dc39d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"
Jul 10 00:21:28.122881 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.123045 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.123045 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.122941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcsx\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.176206 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.176176    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"]
Jul 10 00:21:28.179009 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.178991    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-9vgd4"]
Jul 10 00:21:28.179120 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.179104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"
Jul 10 00:21:28.182008 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.181985    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:21:28.182180 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.182164    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"]
Jul 10 00:21:28.182281 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.182258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.182379 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.182270    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 00:21:28.184857 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.184822    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7xw5x\""
Jul 10 00:21:28.185331 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.185177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.185400 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.185343    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 00:21:28.185659 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.185574    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 00:21:28.186299 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.186281    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nvz99\""
Jul 10 00:21:28.186541 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.186527    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:21:28.187224 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.187204    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 00:21:28.190284 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.190269    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:21:28.191100 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.191080    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-75wbt\""
Jul 10 00:21:28.192761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.192742    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 00:21:28.193122 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.193105    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 00:21:28.195127 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.195104    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 00:21:28.196762 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.196744    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"]
Jul 10 00:21:28.197807 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.197787    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-9vgd4"]
Jul 10 00:21:28.201468 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.201452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"]
Jul 10 00:21:28.224012 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.223988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-trusted-ca\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.224098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fzc5\" (UniqueName: \"kubernetes.io/projected/5d86ddf4-d894-4ccf-aada-d7edb14dc39d-kube-api-access-7fzc5\") pod \"network-check-source-869dcfcdcd-9zjzc\" (UID: \"5d86ddf4-d894-4ccf-aada-d7edb14dc39d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcsx\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224261 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9jw\" (UniqueName: \"kubernetes.io/projected/b7e1be45-306f-433b-94e4-4f37639557df-kube-api-access-kc9jw\") pod \"volume-data-source-validator-78495597f6-lx6wn\" (UID: \"b7e1be45-306f-433b-94e4-4f37639557df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.224265    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.224279    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbfd6d8b4-plzn2: secret "image-registry-tls" not found
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-config\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.224336    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls podName:970f6928-cfd3-4577-8279-a37651fd8a24 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:28.724319045 +0000 UTC m=+213.209610315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls") pod "image-registry-6fbfd6d8b4-plzn2" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24") : secret "image-registry-tls" not found
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-serving-cert\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b27qb\" (UniqueName: \"kubernetes.io/projected/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-kube-api-access-b27qb\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbsp\" (UniqueName: \"kubernetes.io/projected/e9d1b756-3aa0-4f59-96de-00c9bb43664f-kube-api-access-5pbsp\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.224655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.224990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.224973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.225084 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.225068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.226904 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.226886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.226994 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.226912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.234505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.234486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fzc5\" (UniqueName: \"kubernetes.io/projected/5d86ddf4-d894-4ccf-aada-d7edb14dc39d-kube-api-access-7fzc5\") pod \"network-check-source-869dcfcdcd-9zjzc\" (UID: \"5d86ddf4-d894-4ccf-aada-d7edb14dc39d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"
Jul 10 00:21:28.237434 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.237413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.237519 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.237477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcsx\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.325545 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbsp\" (UniqueName: \"kubernetes.io/projected/e9d1b756-3aa0-4f59-96de-00c9bb43664f-kube-api-access-5pbsp\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.325545 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-trusted-ca\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9jw\" (UniqueName: \"kubernetes.io/projected/b7e1be45-306f-433b-94e4-4f37639557df-kube-api-access-kc9jw\") pod \"volume-data-source-validator-78495597f6-lx6wn\" (UID: \"b7e1be45-306f-433b-94e4-4f37639557df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-config\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-serving-cert\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.325676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b27qb\" (UniqueName: \"kubernetes.io/projected/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-kube-api-access-b27qb\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.325749 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.325703    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 00:21:28.326026 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.325765    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls podName:e9d1b756-3aa0-4f59-96de-00c9bb43664f nodeName:}" failed. No retries permitted until 2026-07-10 00:21:28.825747622 +0000 UTC m=+213.311038895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls") pod "cluster-samples-operator-65db858894-dqbs6" (UID: "e9d1b756-3aa0-4f59-96de-00c9bb43664f") : secret "samples-operator-tls" not found
Jul 10 00:21:28.326301 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.326278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-config\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.326443 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.326423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-trusted-ca\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.327964 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.327945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-serving-cert\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.333850 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.333812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9jw\" (UniqueName: \"kubernetes.io/projected/b7e1be45-306f-433b-94e4-4f37639557df-kube-api-access-kc9jw\") pod \"volume-data-source-validator-78495597f6-lx6wn\" (UID: \"b7e1be45-306f-433b-94e4-4f37639557df\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"
Jul 10 00:21:28.333955 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.333934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b27qb\" (UniqueName: \"kubernetes.io/projected/85c9c187-dc0b-4f7e-88fa-d856239bdb7f-kube-api-access-b27qb\") pod \"console-operator-7866497494-9vgd4\" (UID: \"85c9c187-dc0b-4f7e-88fa-d856239bdb7f\") " pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.334136 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.334122    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbsp\" (UniqueName: \"kubernetes.io/projected/e9d1b756-3aa0-4f59-96de-00c9bb43664f-kube-api-access-5pbsp\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.370805 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.370770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"
Jul 10 00:21:28.487066 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.487031    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc"]
Jul 10 00:21:28.488923 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.488890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"
Jul 10 00:21:28.489311 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:28.489289    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d86ddf4_d894_4ccf_aada_d7edb14dc39d.slice/crio-4230a913111fe15b0ddae7e0475660969e20da5460b0c92dadefe35a8742e76f WatchSource:0}: Error finding container 4230a913111fe15b0ddae7e0475660969e20da5460b0c92dadefe35a8742e76f: Status 404 returned error can't find the container with id 4230a913111fe15b0ddae7e0475660969e20da5460b0c92dadefe35a8742e76f
Jul 10 00:21:28.497434 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.497413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:28.621776 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.621749    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn"]
Jul 10 00:21:28.625301 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:28.625275    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e1be45_306f_433b_94e4_4f37639557df.slice/crio-c263ef35ca5c26eb8df2667288cac34ba5937bbff5788faf0905025fe2d96cf4 WatchSource:0}: Error finding container c263ef35ca5c26eb8df2667288cac34ba5937bbff5788faf0905025fe2d96cf4: Status 404 returned error can't find the container with id c263ef35ca5c26eb8df2667288cac34ba5937bbff5788faf0905025fe2d96cf4
Jul 10 00:21:28.635813 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.635783    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-9vgd4"]
Jul 10 00:21:28.639169 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:28.639147    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c9c187_dc0b_4f7e_88fa_d856239bdb7f.slice/crio-29489f192abcce23041465f3d4ff2cd6553e4cfa15b643a2bc90e0ef582d9dfd WatchSource:0}: Error finding container 29489f192abcce23041465f3d4ff2cd6553e4cfa15b643a2bc90e0ef582d9dfd: Status 404 returned error can't find the container with id 29489f192abcce23041465f3d4ff2cd6553e4cfa15b643a2bc90e0ef582d9dfd
Jul 10 00:21:28.729262 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.729228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:28.729418 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.729392    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 00:21:28.729418 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.729412    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbfd6d8b4-plzn2: secret "image-registry-tls" not found
Jul 10 00:21:28.729488 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.729466    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls podName:970f6928-cfd3-4577-8279-a37651fd8a24 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:29.729451281 +0000 UTC m=+214.214742550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls") pod "image-registry-6fbfd6d8b4-plzn2" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24") : secret "image-registry-tls" not found
Jul 10 00:21:28.830098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.830065    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:28.830266 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.830189    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 00:21:28.830266 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:28.830247    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls podName:e9d1b756-3aa0-4f59-96de-00c9bb43664f nodeName:}" failed. No retries permitted until 2026-07-10 00:21:29.83023112 +0000 UTC m=+214.315522389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls") pod "cluster-samples-operator-65db858894-dqbs6" (UID: "e9d1b756-3aa0-4f59-96de-00c9bb43664f") : secret "samples-operator-tls" not found
Jul 10 00:21:28.893442 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.893350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-9vgd4" event={"ID":"85c9c187-dc0b-4f7e-88fa-d856239bdb7f","Type":"ContainerStarted","Data":"29489f192abcce23041465f3d4ff2cd6553e4cfa15b643a2bc90e0ef582d9dfd"}
Jul 10 00:21:28.894760 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.894731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc" event={"ID":"5d86ddf4-d894-4ccf-aada-d7edb14dc39d","Type":"ContainerStarted","Data":"2212281091ad2dbf1b60720567a603d9797f322fdb586ee14bfc650a425d9e24"}
Jul 10 00:21:28.894916 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.894779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc" event={"ID":"5d86ddf4-d894-4ccf-aada-d7edb14dc39d","Type":"ContainerStarted","Data":"4230a913111fe15b0ddae7e0475660969e20da5460b0c92dadefe35a8742e76f"}
Jul 10 00:21:28.895903 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.895878    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn" event={"ID":"b7e1be45-306f-433b-94e4-4f37639557df","Type":"ContainerStarted","Data":"c263ef35ca5c26eb8df2667288cac34ba5937bbff5788faf0905025fe2d96cf4"}
Jul 10 00:21:28.912464 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:28.912420    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-9zjzc" podStartSLOduration=0.912405889 podStartE2EDuration="912.405889ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:28.911596239 +0000 UTC m=+213.396887530" watchObservedRunningTime="2026-07-10 00:21:28.912405889 +0000 UTC m=+213.397697177"
Jul 10 00:21:29.737071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:29.737036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:29.737421 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:29.737200    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 00:21:29.737421 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:29.737214    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbfd6d8b4-plzn2: secret "image-registry-tls" not found
Jul 10 00:21:29.737421 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:29.737302    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls podName:970f6928-cfd3-4577-8279-a37651fd8a24 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:31.737289356 +0000 UTC m=+216.222580625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls") pod "image-registry-6fbfd6d8b4-plzn2" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24") : secret "image-registry-tls" not found
Jul 10 00:21:29.837729 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:29.837699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:29.837916 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:29.837823    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 00:21:29.837916 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:29.837893    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls podName:e9d1b756-3aa0-4f59-96de-00c9bb43664f nodeName:}" failed. No retries permitted until 2026-07-10 00:21:31.837878515 +0000 UTC m=+216.323169784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls") pod "cluster-samples-operator-65db858894-dqbs6" (UID: "e9d1b756-3aa0-4f59-96de-00c9bb43664f") : secret "samples-operator-tls" not found
Jul 10 00:21:29.901381 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:29.901336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn" event={"ID":"b7e1be45-306f-433b-94e4-4f37639557df","Type":"ContainerStarted","Data":"4739ce396fb5097dfe659aebd087a49d0c3b81e6d16987bf9327bb0aaef24b28"}
Jul 10 00:21:29.916703 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:29.916648    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lx6wn" podStartSLOduration=0.795517923 podStartE2EDuration="1.916630904s" totalImagesPullingTime="1.121112981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:29.916101297 +0000 UTC m=+214.401392588" watchObservedRunningTime="2026-07-10 00:21:29.916630904 +0000 UTC m=+214.401922196"
Jul 10 00:21:30.905141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:30.905115    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/0.log"
Jul 10 00:21:30.905511 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:30.905151    2575 generic.go:356] "Generic (PLEG): container finished" podID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f" containerID="fa4b88a20d5801c3ddcb0bacc9b58813ff7eedfe6eb73109954c4d7f041c8e47" exitCode=255
Jul 10 00:21:30.905511 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:30.905224    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-9vgd4" event={"ID":"85c9c187-dc0b-4f7e-88fa-d856239bdb7f","Type":"ContainerDied","Data":"fa4b88a20d5801c3ddcb0bacc9b58813ff7eedfe6eb73109954c4d7f041c8e47"}
Jul 10 00:21:30.905511 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:30.905392    2575 scope.go:117] "RemoveContainer" containerID="fa4b88a20d5801c3ddcb0bacc9b58813ff7eedfe6eb73109954c4d7f041c8e47"
Jul 10 00:21:31.751809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.751760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:31.751989 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.751928    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 00:21:31.751989 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.751948    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbfd6d8b4-plzn2: secret "image-registry-tls" not found
Jul 10 00:21:31.752067 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.751999    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls podName:970f6928-cfd3-4577-8279-a37651fd8a24 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:35.751985272 +0000 UTC m=+220.237276541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls") pod "image-registry-6fbfd6d8b4-plzn2" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24") : secret "image-registry-tls" not found
Jul 10 00:21:31.853105 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.853073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:31.853268 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.853245    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 00:21:31.853341 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.853329    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls podName:e9d1b756-3aa0-4f59-96de-00c9bb43664f nodeName:}" failed. No retries permitted until 2026-07-10 00:21:35.853308278 +0000 UTC m=+220.338599554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls") pod "cluster-samples-operator-65db858894-dqbs6" (UID: "e9d1b756-3aa0-4f59-96de-00c9bb43664f") : secret "samples-operator-tls" not found
Jul 10 00:21:31.910006 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.909979    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/1.log"
Jul 10 00:21:31.910408 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.910369    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/0.log"
Jul 10 00:21:31.910408 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.910397    2575 generic.go:356] "Generic (PLEG): container finished" podID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a" exitCode=255
Jul 10 00:21:31.910477 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.910438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-9vgd4" event={"ID":"85c9c187-dc0b-4f7e-88fa-d856239bdb7f","Type":"ContainerDied","Data":"3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"}
Jul 10 00:21:31.910510 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.910476    2575 scope.go:117] "RemoveContainer" containerID="fa4b88a20d5801c3ddcb0bacc9b58813ff7eedfe6eb73109954c4d7f041c8e47"
Jul 10 00:21:31.910671 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:31.910653    2575 scope.go:117] "RemoveContainer" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"
Jul 10 00:21:31.910872 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:31.910849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:21:32.208608 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.208577    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5rwbz"]
Jul 10 00:21:32.212769 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.212749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.215008 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.214990    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 00:21:32.215163 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.215141    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 00:21:32.215234 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.215212    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 00:21:32.215295 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.215265    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6fk5l\""
Jul 10 00:21:32.215553 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.215537    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 00:21:32.220956 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.220933    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5rwbz"]
Jul 10 00:21:32.256516 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.256489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpd9x\" (UniqueName: \"kubernetes.io/projected/b871c525-2361-441d-8376-5934c37069e1-kube-api-access-wpd9x\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.256613 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.256520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.256613 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.256598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b871c525-2361-441d-8376-5934c37069e1-crio-socket\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.256683 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.256628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.256683 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.256672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b871c525-2361-441d-8376-5934c37069e1-data-volume\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357270 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b871c525-2361-441d-8376-5934c37069e1-crio-socket\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357270 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b871c525-2361-441d-8376-5934c37069e1-data-volume\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpd9x\" (UniqueName: \"kubernetes.io/projected/b871c525-2361-441d-8376-5934c37069e1-kube-api-access-wpd9x\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b871c525-2361-441d-8376-5934c37069e1-crio-socket\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.357408    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.357465    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:32.857451673 +0000 UTC m=+217.342742947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:32.357494 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.357408    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 00:21:32.357761 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.357508    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:32.857499681 +0000 UTC m=+217.342790972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : configmap "kube-rbac-proxy" not found
Jul 10 00:21:32.357761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.357650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b871c525-2361-441d-8376-5934c37069e1-data-volume\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.367608 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.367586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpd9x\" (UniqueName: \"kubernetes.io/projected/b871c525-2361-441d-8376-5934c37069e1-kube-api-access-wpd9x\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.546165 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.546077    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"]
Jul 10 00:21:32.549105 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.549084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"
Jul 10 00:21:32.551568 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.551550    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mxhjx\""
Jul 10 00:21:32.551652 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.551595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 10 00:21:32.551708 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.551649    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 10 00:21:32.558648 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.558624    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"]
Jul 10 00:21:32.659016 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.658977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwx76\" (UniqueName: \"kubernetes.io/projected/8d7de5cc-3c9f-479b-80a5-40179774e9ec-kube-api-access-qwx76\") pod \"migrator-7f59b54f6c-vlqx2\" (UID: \"8d7de5cc-3c9f-479b-80a5-40179774e9ec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"
Jul 10 00:21:32.760390 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.760354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwx76\" (UniqueName: \"kubernetes.io/projected/8d7de5cc-3c9f-479b-80a5-40179774e9ec-kube-api-access-qwx76\") pod \"migrator-7f59b54f6c-vlqx2\" (UID: \"8d7de5cc-3c9f-479b-80a5-40179774e9ec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"
Jul 10 00:21:32.770304 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.770278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwx76\" (UniqueName: \"kubernetes.io/projected/8d7de5cc-3c9f-479b-80a5-40179774e9ec-kube-api-access-qwx76\") pod \"migrator-7f59b54f6c-vlqx2\" (UID: \"8d7de5cc-3c9f-479b-80a5-40179774e9ec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"
Jul 10 00:21:32.858086 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.858006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"
Jul 10 00:21:32.860976 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.860758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.860976 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.860821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:32.860976 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.860929    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:32.860976 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.860937    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 00:21:32.861102 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.861009    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:33.860978874 +0000 UTC m=+218.346270147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : configmap "kube-rbac-proxy" not found
Jul 10 00:21:32.861102 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.861026    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:33.861018256 +0000 UTC m=+218.346309524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:32.921744 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.921318    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/1.log"
Jul 10 00:21:32.922478 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.922273    2575 scope.go:117] "RemoveContainer" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"
Jul 10 00:21:32.922596 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:32.922478    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:21:32.979172 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:32.979145    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2"]
Jul 10 00:21:32.982405 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:32.982380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7de5cc_3c9f_479b_80a5_40179774e9ec.slice/crio-2ebacc8da8ed2f9aa22eafdd6342cf323638df2c6e9049c07abba73d192271a7 WatchSource:0}: Error finding container 2ebacc8da8ed2f9aa22eafdd6342cf323638df2c6e9049c07abba73d192271a7: Status 404 returned error can't find the container with id 2ebacc8da8ed2f9aa22eafdd6342cf323638df2c6e9049c07abba73d192271a7
Jul 10 00:21:33.868142 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:33.868103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:33.868427 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:33.868203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:33.868427 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:33.868211    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 00:21:33.868427 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:33.868301    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:35.86828052 +0000 UTC m=+220.353571790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : configmap "kube-rbac-proxy" not found
Jul 10 00:21:33.868427 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:33.868322    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:33.868427 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:33.868369    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:35.868355331 +0000 UTC m=+220.353646603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:33.926274 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:33.926235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2" event={"ID":"8d7de5cc-3c9f-479b-80a5-40179774e9ec","Type":"ContainerStarted","Data":"2ebacc8da8ed2f9aa22eafdd6342cf323638df2c6e9049c07abba73d192271a7"}
Jul 10 00:21:34.190153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:34.190126    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqqjj_56a71be3-f920-4543-8aca-caaa777619e1/dns-node-resolver/0.log"
Jul 10 00:21:34.930446 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:34.930419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2" event={"ID":"8d7de5cc-3c9f-479b-80a5-40179774e9ec","Type":"ContainerStarted","Data":"c5dfeba1e1b715d0353de5148409156fb53a7c420fa8d6ce1fdab6696cc17a00"}
Jul 10 00:21:34.930816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:34.930466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2" event={"ID":"8d7de5cc-3c9f-479b-80a5-40179774e9ec","Type":"ContainerStarted","Data":"3b0081bcbaaaca288dc9fe2d6eabc66367848cf195605a6bd1e574f48e650aca"}
Jul 10 00:21:34.950268 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:34.950225    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-vlqx2" podStartSLOduration=1.5675153819999998 podStartE2EDuration="2.95021038s" totalImagesPullingTime="1.382694998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:34.948622312 +0000 UTC m=+219.433913605" watchObservedRunningTime="2026-07-10 00:21:34.95021038 +0000 UTC m=+219.435501671"
Jul 10 00:21:35.383260 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.383192    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r97px_6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0/node-ca/0.log"
Jul 10 00:21:35.781454 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.781431    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clh6w_4b4ee644-afb1-49d9-87a7-d49900f2a54d/serve-healthcheck-canary/0.log"
Jul 10 00:21:35.782545 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.782525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:35.782695 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.782675    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 00:21:35.782761 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.782698    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbfd6d8b4-plzn2: secret "image-registry-tls" not found
Jul 10 00:21:35.782812 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.782762    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls podName:970f6928-cfd3-4577-8279-a37651fd8a24 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:43.782743641 +0000 UTC m=+228.268034922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls") pod "image-registry-6fbfd6d8b4-plzn2" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24") : secret "image-registry-tls" not found
Jul 10 00:21:35.883123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.883080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:35.883278 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.883143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:35.883278 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:35.883171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:35.883278 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883242    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 00:21:35.883278 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883267    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 00:21:35.883406 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883253    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:35.883406 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883314    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls podName:e9d1b756-3aa0-4f59-96de-00c9bb43664f nodeName:}" failed. No retries permitted until 2026-07-10 00:21:43.883295737 +0000 UTC m=+228.368587010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls") pod "cluster-samples-operator-65db858894-dqbs6" (UID: "e9d1b756-3aa0-4f59-96de-00c9bb43664f") : secret "samples-operator-tls" not found
Jul 10 00:21:35.883406 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883330    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:39.883321747 +0000 UTC m=+224.368613015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : configmap "kube-rbac-proxy" not found
Jul 10 00:21:35.883406 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:35.883344    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:39.88333677 +0000 UTC m=+224.368628039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:38.498082 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:38.498051    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:38.498478 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:38.498104    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:38.498478 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:38.498431    2575 scope.go:117] "RemoveContainer" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"
Jul 10 00:21:38.498587 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:38.498567    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:21:39.914981 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:39.914941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:39.915392 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:39.915002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:39.915392 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:39.915081    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 00:21:39.915392 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:39.915088    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:39.915392 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:39.915130    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:47.915116888 +0000 UTC m=+232.400408157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : configmap "kube-rbac-proxy" not found
Jul 10 00:21:39.915392 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:39.915142    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls podName:b871c525-2361-441d-8376-5934c37069e1 nodeName:}" failed. No retries permitted until 2026-07-10 00:21:47.915136348 +0000 UTC m=+232.400427616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5rwbz" (UID: "b871c525-2361-441d-8376-5934c37069e1") : secret "insights-runtime-extractor-tls" not found
Jul 10 00:21:43.848794 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:43.848756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:43.851052 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:43.851032    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"image-registry-6fbfd6d8b4-plzn2\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") " pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:43.949287 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:43.949257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:43.951395 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:43.951378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9d1b756-3aa0-4f59-96de-00c9bb43664f-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dqbs6\" (UID: \"e9d1b756-3aa0-4f59-96de-00c9bb43664f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:43.979302 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:43.979276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:44.100684 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.100623    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:21:44.102413 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.102394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"
Jul 10 00:21:44.104111 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:44.104087    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970f6928_cfd3_4577_8279_a37651fd8a24.slice/crio-d5d046cc73d1d7428d6b7babafe84b041126c8d9d8c640de4f0778318f06caa9 WatchSource:0}: Error finding container d5d046cc73d1d7428d6b7babafe84b041126c8d9d8c640de4f0778318f06caa9: Status 404 returned error can't find the container with id d5d046cc73d1d7428d6b7babafe84b041126c8d9d8c640de4f0778318f06caa9
Jul 10 00:21:44.234787 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.234756    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6"]
Jul 10 00:21:44.959324 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.959289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" event={"ID":"970f6928-cfd3-4577-8279-a37651fd8a24","Type":"ContainerStarted","Data":"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"}
Jul 10 00:21:44.959803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.959348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" event={"ID":"970f6928-cfd3-4577-8279-a37651fd8a24","Type":"ContainerStarted","Data":"d5d046cc73d1d7428d6b7babafe84b041126c8d9d8c640de4f0778318f06caa9"}
Jul 10 00:21:44.959803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.959398    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:21:44.960807 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.960782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6" event={"ID":"e9d1b756-3aa0-4f59-96de-00c9bb43664f","Type":"ContainerStarted","Data":"9fde55e2a1c507c1cbd9ab7d3eb8dca53c31da622daf694936d3d39eefa25641"}
Jul 10 00:21:44.980849 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:44.980791    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" podStartSLOduration=16.9807787 podStartE2EDuration="16.9807787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:44.980738503 +0000 UTC m=+229.466029805" watchObservedRunningTime="2026-07-10 00:21:44.9807787 +0000 UTC m=+229.466069992"
Jul 10 00:21:46.972114 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:46.972075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6" event={"ID":"e9d1b756-3aa0-4f59-96de-00c9bb43664f","Type":"ContainerStarted","Data":"2c6db5c4d43199e52272f1618ef7bbbefb0565accd246f9a6492da333b806b61"}
Jul 10 00:21:46.972489 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:46.972133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6" event={"ID":"e9d1b756-3aa0-4f59-96de-00c9bb43664f","Type":"ContainerStarted","Data":"bd4fc1f02b619b4d41a8915785b8f2716243335225de8f60dd1569533103058d"}
Jul 10 00:21:46.987288 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:46.987241    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dqbs6" podStartSLOduration=17.21696719 podStartE2EDuration="18.987226753s" totalImagesPullingTime="1.770259563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:46.986662806 +0000 UTC m=+231.471954099" watchObservedRunningTime="2026-07-10 00:21:46.987226753 +0000 UTC m=+231.472518044"
Jul 10 00:21:47.982640 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:47.982610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:47.983023 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:47.982651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:47.983123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:47.983095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b871c525-2361-441d-8376-5934c37069e1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:47.984823 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:47.984802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b871c525-2361-441d-8376-5934c37069e1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5rwbz\" (UID: \"b871c525-2361-441d-8376-5934c37069e1\") " pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:48.122464 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:48.122424    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5rwbz"
Jul 10 00:21:48.242455 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:48.242387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5rwbz"]
Jul 10 00:21:48.245059 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:48.245031    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb871c525_2361_441d_8376_5934c37069e1.slice/crio-7bd72b0df540b32a56a50e2813e385cfaaafc2f63e478fdc35bf389873c6fdb0 WatchSource:0}: Error finding container 7bd72b0df540b32a56a50e2813e385cfaaafc2f63e478fdc35bf389873c6fdb0: Status 404 returned error can't find the container with id 7bd72b0df540b32a56a50e2813e385cfaaafc2f63e478fdc35bf389873c6fdb0
Jul 10 00:21:48.982627 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:48.982565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rwbz" event={"ID":"b871c525-2361-441d-8376-5934c37069e1","Type":"ContainerStarted","Data":"7bd72b0df540b32a56a50e2813e385cfaaafc2f63e478fdc35bf389873c6fdb0"}
Jul 10 00:21:52.185924 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.185903    2575 scope.go:117] "RemoveContainer" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"
Jul 10 00:21:52.998941 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.998869    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:21:52.999250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.999235    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/1.log"
Jul 10 00:21:52.999294 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.999267    2575 generic.go:356] "Generic (PLEG): container finished" podID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f" containerID="1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18" exitCode=255
Jul 10 00:21:52.999364 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.999343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-9vgd4" event={"ID":"85c9c187-dc0b-4f7e-88fa-d856239bdb7f","Type":"ContainerDied","Data":"1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18"}
Jul 10 00:21:53.000221 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:52.999430    2575 scope.go:117] "RemoveContainer" containerID="3a38cb9ec36ab68fbcf1b1b949365b7210a51532e9af58e03c220fc65e419d1a"
Jul 10 00:21:53.000333 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:53.000289    2575 scope.go:117] "RemoveContainer" containerID="1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18"
Jul 10 00:21:53.000488 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:53.000465    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:21:53.000966 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:53.000944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rwbz" event={"ID":"b871c525-2361-441d-8376-5934c37069e1","Type":"ContainerStarted","Data":"9e7bd283dbc1fe69cc53f6a34d2145f9f0c1316c413501ed0cf77e3c146620f5"}
Jul 10 00:21:53.001038 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:53.000987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rwbz" event={"ID":"b871c525-2361-441d-8376-5934c37069e1","Type":"ContainerStarted","Data":"d7e17ac3e7d771d7474147216436661b859817656a099376a761dd331574e20d"}
Jul 10 00:21:54.006462 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:54.006428    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:21:56.015738 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:56.015708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5rwbz" event={"ID":"b871c525-2361-441d-8376-5934c37069e1","Type":"ContainerStarted","Data":"dedebf9f278bccd454a64e74c7b089ee528a35d657f690baa0e6a0b65a0fe37e"}
Jul 10 00:21:56.034597 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:56.034536    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5rwbz" podStartSLOduration=17.215153165 podStartE2EDuration="24.034515681s" totalImagesPullingTime="6.819362516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:21:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:56.032277824 +0000 UTC m=+240.517569120" watchObservedRunningTime="2026-07-10 00:21:56.034515681 +0000 UTC m=+240.519806972"
Jul 10 00:21:57.318409 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.318370    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:21:57.355701 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.355671    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74db7c95b8-8vcm6"]
Jul 10 00:21:57.359044 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.359028    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.371128 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.371101    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db7c95b8-8vcm6"]
Jul 10 00:21:57.457634 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7252300c-3de8-424d-bbec-8a70a5998c51-ca-trust-extracted\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.457821 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-trusted-ca\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.457821 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-installation-pull-secrets\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.457821 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85289\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-kube-api-access-85289\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.457821 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-registry-tls\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.458056 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-registry-certificates\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.458056 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-image-registry-private-configuration\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.458056 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.457944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-bound-sa-token\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558422 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-image-registry-private-configuration\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558422 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-bound-sa-token\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7252300c-3de8-424d-bbec-8a70a5998c51-ca-trust-extracted\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-trusted-ca\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-installation-pull-secrets\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85289\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-kube-api-access-85289\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-registry-tls\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.558679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-registry-certificates\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.559030 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.558901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7252300c-3de8-424d-bbec-8a70a5998c51-ca-trust-extracted\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.559517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.559492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-trusted-ca\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.559517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.559506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7252300c-3de8-424d-bbec-8a70a5998c51-registry-certificates\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.561024 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.561001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-installation-pull-secrets\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.561024 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.561021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7252300c-3de8-424d-bbec-8a70a5998c51-image-registry-private-configuration\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.561197 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.561182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-registry-tls\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.568687 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.568631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-bound-sa-token\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.569069 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.569049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85289\" (UniqueName: \"kubernetes.io/projected/7252300c-3de8-424d-bbec-8a70a5998c51-kube-api-access-85289\") pod \"image-registry-74db7c95b8-8vcm6\" (UID: \"7252300c-3de8-424d-bbec-8a70a5998c51\") " pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.667487 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.667447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:57.794896 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:57.794746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74db7c95b8-8vcm6"]
Jul 10 00:21:57.797248 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:21:57.797225    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7252300c_3de8_424d_bbec_8a70a5998c51.slice/crio-6083a8e9c08a99bc59fe6aef446ddecfd00f1d94593cec9b085542e1f4b01ead WatchSource:0}: Error finding container 6083a8e9c08a99bc59fe6aef446ddecfd00f1d94593cec9b085542e1f4b01ead: Status 404 returned error can't find the container with id 6083a8e9c08a99bc59fe6aef446ddecfd00f1d94593cec9b085542e1f4b01ead
Jul 10 00:21:58.025626 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.025591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6" event={"ID":"7252300c-3de8-424d-bbec-8a70a5998c51","Type":"ContainerStarted","Data":"0d5e7b229ec652f76ef0feb52c755b76c46bd6d17b073ef4a15b32b53294ebb6"}
Jul 10 00:21:58.025767 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.025641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6" event={"ID":"7252300c-3de8-424d-bbec-8a70a5998c51","Type":"ContainerStarted","Data":"6083a8e9c08a99bc59fe6aef446ddecfd00f1d94593cec9b085542e1f4b01ead"}
Jul 10 00:21:58.025767 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.025722    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:21:58.043875 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.043812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6" podStartSLOduration=1.043795837 podStartE2EDuration="1.043795837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:21:58.042862689 +0000 UTC m=+242.528153977" watchObservedRunningTime="2026-07-10 00:21:58.043795837 +0000 UTC m=+242.529087142"
Jul 10 00:21:58.498451 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.498417    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:58.498893 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.498467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:21:58.498893 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:21:58.498762    2575 scope.go:117] "RemoveContainer" containerID="1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18"
Jul 10 00:21:58.498977 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:21:58.498925    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:22:07.324028 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.323993    2575 patch_prober.go:28] interesting pod/image-registry-6fbfd6d8b4-plzn2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 00:22:07.324412 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.324056    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 00:22:07.939535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.939492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:22:07.941730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.941706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a795161-ed87-4547-94f9-1cf3a22652bf-metrics-certs\") pod \"network-metrics-daemon-qhs8w\" (UID: \"5a795161-ed87-4547-94f9-1cf3a22652bf\") " pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:22:07.988726 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.988701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l7wp6\""
Jul 10 00:22:07.995918 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:07.995893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qhs8w"
Jul 10 00:22:08.118651 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:08.118618    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qhs8w"]
Jul 10 00:22:08.121392 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:08.121366    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a795161_ed87_4547_94f9_1cf3a22652bf.slice/crio-f4a3db3d6605bd2e253d4f1f12459a41a171249c36bf8242b93c072a56f1019c WatchSource:0}: Error finding container f4a3db3d6605bd2e253d4f1f12459a41a171249c36bf8242b93c072a56f1019c: Status 404 returned error can't find the container with id f4a3db3d6605bd2e253d4f1f12459a41a171249c36bf8242b93c072a56f1019c
Jul 10 00:22:09.059479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.059445    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhs8w" event={"ID":"5a795161-ed87-4547-94f9-1cf3a22652bf","Type":"ContainerStarted","Data":"f4a3db3d6605bd2e253d4f1f12459a41a171249c36bf8242b93c072a56f1019c"}
Jul 10 00:22:09.873505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.873475    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ww4jd"]
Jul 10 00:22:09.876665 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.876650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.879433 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.879405    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7qsh\""
Jul 10 00:22:09.879433 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.879407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 00:22:09.879611 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.879546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 00:22:09.880721 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.880697    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 00:22:09.880905 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.880740    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 00:22:09.880905 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.880803    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 00:22:09.880905 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.880807    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 00:22:09.955214 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-metrics-client-ca\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955214 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-root\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9wh\" (UniqueName: \"kubernetes.io/projected/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-kube-api-access-xx9wh\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-textfile\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-tls\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955586 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-sys\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:09.955586 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:09.955454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-wtmp\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-sys\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056537 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-wtmp\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-metrics-client-ca\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-sys\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-root\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-wtmp\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9wh\" (UniqueName: \"kubernetes.io/projected/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-kube-api-access-xx9wh\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-root\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.056764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-textfile\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057135 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-tls\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057135 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057135 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.056900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.057165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-textfile\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057290 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.057225    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-metrics-client-ca\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.057379 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.057361    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.059186 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.059155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-tls\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.059288 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.059239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.065418 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.065388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhs8w" event={"ID":"5a795161-ed87-4547-94f9-1cf3a22652bf","Type":"ContainerStarted","Data":"a8978e0f5d7fe0518f2b584d08392ce9af28409ec592679f39aa8df47262f337"}
Jul 10 00:22:10.065810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.065453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qhs8w" event={"ID":"5a795161-ed87-4547-94f9-1cf3a22652bf","Type":"ContainerStarted","Data":"d659bf9820fc60d1561ab41ba8b509512627f813a2effec120e3c832e7690725"}
Jul 10 00:22:10.066553 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.066531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9wh\" (UniqueName: \"kubernetes.io/projected/ee0ce80b-1e4e-47b6-b736-de757d50e9ee-kube-api-access-xx9wh\") pod \"node-exporter-ww4jd\" (UID: \"ee0ce80b-1e4e-47b6-b736-de757d50e9ee\") " pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.082050 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.082003    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qhs8w" podStartSLOduration=252.898177616 podStartE2EDuration="4m14.081986822s" totalImagesPullingTime="1.183809206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:10.081683569 +0000 UTC m=+254.566974859" watchObservedRunningTime="2026-07-10 00:22:10.081986822 +0000 UTC m=+254.567278112"
Jul 10 00:22:10.186385 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:10.186349    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ww4jd"
Jul 10 00:22:10.200280 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:10.200251    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0ce80b_1e4e_47b6_b736_de757d50e9ee.slice/crio-8014e8305f78e3c3fff06efa5b722e55e19214d3b508ce4b1f96ff37659165a4 WatchSource:0}: Error finding container 8014e8305f78e3c3fff06efa5b722e55e19214d3b508ce4b1f96ff37659165a4: Status 404 returned error can't find the container with id 8014e8305f78e3c3fff06efa5b722e55e19214d3b508ce4b1f96ff37659165a4
Jul 10 00:22:11.070459 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:11.070419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww4jd" event={"ID":"ee0ce80b-1e4e-47b6-b736-de757d50e9ee","Type":"ContainerStarted","Data":"8014e8305f78e3c3fff06efa5b722e55e19214d3b508ce4b1f96ff37659165a4"}
Jul 10 00:22:12.076270 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:12.076238    2575 generic.go:356] "Generic (PLEG): container finished" podID="ee0ce80b-1e4e-47b6-b736-de757d50e9ee" containerID="ad2ba4493042ce5899cba7e011bacfb84df6efaca241cf365ab1cdfea83ed3ff" exitCode=0
Jul 10 00:22:12.076660 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:12.076292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww4jd" event={"ID":"ee0ce80b-1e4e-47b6-b736-de757d50e9ee","Type":"ContainerDied","Data":"ad2ba4493042ce5899cba7e011bacfb84df6efaca241cf365ab1cdfea83ed3ff"}
Jul 10 00:22:12.185776 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:12.185756    2575 scope.go:117] "RemoveContainer" containerID="1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18"
Jul 10 00:22:12.185976 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:22:12.185929    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-9vgd4_openshift-console-operator(85c9c187-dc0b-4f7e-88fa-d856239bdb7f)\"" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podUID="85c9c187-dc0b-4f7e-88fa-d856239bdb7f"
Jul 10 00:22:13.081681 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:13.081646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww4jd" event={"ID":"ee0ce80b-1e4e-47b6-b736-de757d50e9ee","Type":"ContainerStarted","Data":"36a7014262d4534ee4b8c0e55012586c2a217827a5c90e566f3fd4041b0fba9f"}
Jul 10 00:22:13.082085 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:13.081708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww4jd" event={"ID":"ee0ce80b-1e4e-47b6-b736-de757d50e9ee","Type":"ContainerStarted","Data":"cc7f25cee11fe3e2feee560bf02eee91093a530f1566e1386bf4a10b5e2379d0"}
Jul 10 00:22:13.100524 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:13.100475    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ww4jd" podStartSLOduration=2.679882416 podStartE2EDuration="4.100457415s" totalImagesPullingTime="1.357152682s" totalInitContainerRuntime="63.422317ms" isStatefulPod=true podCreationTimestamp="2026-07-10 00:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:13.099234 +0000 UTC m=+257.584525302" watchObservedRunningTime="2026-07-10 00:22:13.100457415 +0000 UTC m=+257.585748706"
Jul 10 00:22:14.145239 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.145206    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65666bdb99-mkbxz"]
Jul 10 00:22:14.148491 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.148474    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.152557 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152531    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 00:22:14.152557 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152552    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 00:22:14.152752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152537    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bvoahcocd6u0s\""
Jul 10 00:22:14.152752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152532    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v2nxl\""
Jul 10 00:22:14.152752 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152615    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 00:22:14.152885 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.152856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 00:22:14.158581 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.158559    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65666bdb99-mkbxz"]
Jul 10 00:22:14.188352 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-metrics-server-audit-profiles\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188352 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmn8\" (UniqueName: \"kubernetes.io/projected/04f67c5d-8f47-45a7-b29c-43e695de6e9d-kube-api-access-vzmn8\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188566 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-client-certs\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188566 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04f67c5d-8f47-45a7-b29c-43e695de6e9d-audit-log\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188657 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188644    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-client-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188709 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.188809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.188786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-tls\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.289882 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.289829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.289906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-tls\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.289946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-metrics-server-audit-profiles\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.289966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmn8\" (UniqueName: \"kubernetes.io/projected/04f67c5d-8f47-45a7-b29c-43e695de6e9d-kube-api-access-vzmn8\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.289999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-client-certs\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.290025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04f67c5d-8f47-45a7-b29c-43e695de6e9d-audit-log\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.290057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-client-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290540 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.290508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04f67c5d-8f47-45a7-b29c-43e695de6e9d-audit-log\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.290702 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.290674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.291030 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.291005    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04f67c5d-8f47-45a7-b29c-43e695de6e9d-metrics-server-audit-profiles\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.292494 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.292469    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-client-certs\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.292592 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.292580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-secret-metrics-server-tls\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.292647 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.292627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04f67c5d-8f47-45a7-b29c-43e695de6e9d-client-ca-bundle\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.297657 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.297636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmn8\" (UniqueName: \"kubernetes.io/projected/04f67c5d-8f47-45a7-b29c-43e695de6e9d-kube-api-access-vzmn8\") pod \"metrics-server-65666bdb99-mkbxz\" (UID: \"04f67c5d-8f47-45a7-b29c-43e695de6e9d\") " pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.457192 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.457150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:14.592221 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:14.592187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65666bdb99-mkbxz"]
Jul 10 00:22:14.594863 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:14.594821    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f67c5d_8f47_45a7_b29c_43e695de6e9d.slice/crio-fcb14c2e4f581ead9c9fdf167fbd59ba0cf937c33df32b7fb91e34ac5bdfeebe WatchSource:0}: Error finding container fcb14c2e4f581ead9c9fdf167fbd59ba0cf937c33df32b7fb91e34ac5bdfeebe: Status 404 returned error can't find the container with id fcb14c2e4f581ead9c9fdf167fbd59ba0cf937c33df32b7fb91e34ac5bdfeebe
Jul 10 00:22:15.039349 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.039317    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f565978fc-7xhp7"]
Jul 10 00:22:15.043521 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.043501    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.046151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046131    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lm9gv\""
Jul 10 00:22:15.046297 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046154    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 00:22:15.046420 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046403    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 00:22:15.046479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046401    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 00:22:15.046479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046438    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 00:22:15.046479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.046406    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 00:22:15.056899 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.056482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f565978fc-7xhp7"]
Jul 10 00:22:15.058773 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.058743    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 00:22:15.090332 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.090297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz" event={"ID":"04f67c5d-8f47-45a7-b29c-43e695de6e9d","Type":"ContainerStarted","Data":"fcb14c2e4f581ead9c9fdf167fbd59ba0cf937c33df32b7fb91e34ac5bdfeebe"}
Jul 10 00:22:15.096715 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096783 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096783 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4hv\" (UniqueName: \"kubernetes.io/projected/99980b3a-db95-4a3b-913c-f2ff61e20c21-kube-api-access-jr4hv\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096869 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-serving-certs-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096905 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-federate-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096905 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096968 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.096968 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.096964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-metrics-client-ca\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.197827 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.197784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-serving-certs-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.197827 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.197844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-federate-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.197873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.197893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.197938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-metrics-client-ca\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.198013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.198052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198380 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.198080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4hv\" (UniqueName: \"kubernetes.io/projected/99980b3a-db95-4a3b-913c-f2ff61e20c21-kube-api-access-jr4hv\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.198769 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.198739    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-serving-certs-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.199479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.199455    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.199479 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.199470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99980b3a-db95-4a3b-913c-f2ff61e20c21-metrics-client-ca\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.200936 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.200902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-federate-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.201388 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.201367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.201470 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.201450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-telemeter-client-tls\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.202668 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.202643    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/99980b3a-db95-4a3b-913c-f2ff61e20c21-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.207121 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.207102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4hv\" (UniqueName: \"kubernetes.io/projected/99980b3a-db95-4a3b-913c-f2ff61e20c21-kube-api-access-jr4hv\") pod \"telemeter-client-7f565978fc-7xhp7\" (UID: \"99980b3a-db95-4a3b-913c-f2ff61e20c21\") " pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.356033 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.355944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7"
Jul 10 00:22:15.506576 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:15.506552    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f565978fc-7xhp7"]
Jul 10 00:22:15.509123 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:15.509097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99980b3a_db95_4a3b_913c_f2ff61e20c21.slice/crio-fd39a9bcea406143fdd4d453fef412a5a7e18b25610f0f4ae0de8b57c9062f62 WatchSource:0}: Error finding container fd39a9bcea406143fdd4d453fef412a5a7e18b25610f0f4ae0de8b57c9062f62: Status 404 returned error can't find the container with id fd39a9bcea406143fdd4d453fef412a5a7e18b25610f0f4ae0de8b57c9062f62
Jul 10 00:22:16.033151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.033120    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:22:16.036882 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.036860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.039690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.039665    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 00:22:16.039690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.039678    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 00:22:16.040016 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.039999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 00:22:16.040104 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040060    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s8c5s\""
Jul 10 00:22:16.040104 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040098    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 00:22:16.040207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040127    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 00:22:16.040264 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040212    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 00:22:16.040484 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040465    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 00:22:16.040587 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.040465    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5kgdgvogbce0e\""
Jul 10 00:22:16.041349 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 00:22:16.041462 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 00:22:16.041568 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041553    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 00:22:16.041628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041576    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 00:22:16.041628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 00:22:16.041628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.041602    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 00:22:16.042786 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.042769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 00:22:16.051282 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.051262    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:22:16.094517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.094492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7" event={"ID":"99980b3a-db95-4a3b-913c-f2ff61e20c21","Type":"ContainerStarted","Data":"fd39a9bcea406143fdd4d453fef412a5a7e18b25610f0f4ae0de8b57c9062f62"}
Jul 10 00:22:16.106889 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.106852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.106981 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.106892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.106981 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.106910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.106981 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.106958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107075 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.106992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107075 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107075 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107075 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107190 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107190 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107190 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107276 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107276 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107276 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107276 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107401 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107401 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvlws\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.107505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.107475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208184 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208184 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208332    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.208633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvlws\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209250 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.208896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.209771 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.209623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.211786 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.211763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.211915 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.211817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.212181 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.212161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.212756 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.212406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.212756 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.212503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.212937 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.212818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.213338 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.213242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.213338 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.213277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.213886 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.213861    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214055 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.213909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214272 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214389 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214658 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214741 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214741 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.214898 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.214878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.215032 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.215018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.220753 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.220733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvlws\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws\") pod \"prometheus-k8s-0\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.347218 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.347130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:16.489967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:16.489926    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:22:16.494903 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:16.494875    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010d7774_3316_4384_9a70_dfbabe078da3.slice/crio-bd1018e04afe03c802ce042caf9b93fa857f9b6ef316d84256d9eab52d082f41 WatchSource:0}: Error finding container bd1018e04afe03c802ce042caf9b93fa857f9b6ef316d84256d9eab52d082f41: Status 404 returned error can't find the container with id bd1018e04afe03c802ce042caf9b93fa857f9b6ef316d84256d9eab52d082f41
Jul 10 00:22:17.099694 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:17.099653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"bd1018e04afe03c802ce042caf9b93fa857f9b6ef316d84256d9eab52d082f41"}
Jul 10 00:22:17.101406 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:17.101373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz" event={"ID":"04f67c5d-8f47-45a7-b29c-43e695de6e9d","Type":"ContainerStarted","Data":"c9c07b7cb3beab81d54aedb00185f0999a2a9848abb86ca221bf6f4586aa0433"}
Jul 10 00:22:17.118974 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:17.118915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz" podStartSLOduration=1.632654512 podStartE2EDuration="3.118895304s" totalImagesPullingTime="1.486240792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:17.118493698 +0000 UTC m=+261.603785009" watchObservedRunningTime="2026-07-10 00:22:17.118895304 +0000 UTC m=+261.604186595"
Jul 10 00:22:17.324978 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:17.324896    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:22:19.033212 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.033188    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74db7c95b8-8vcm6"
Jul 10 00:22:19.110981 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.110946    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b" exitCode=0
Jul 10 00:22:19.111136 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.111039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b"}
Jul 10 00:22:19.113245 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.113227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7" event={"ID":"99980b3a-db95-4a3b-913c-f2ff61e20c21","Type":"ContainerStarted","Data":"5ba42439970f74c5e7fba92d93273fa3edc4405c9a80bd3b25572c43d208eacc"}
Jul 10 00:22:19.113349 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.113269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7" event={"ID":"99980b3a-db95-4a3b-913c-f2ff61e20c21","Type":"ContainerStarted","Data":"09a27a7fe925768e54309cbd60a383cb58ac9cd3e2b7f70b9751a5bafac25dfc"}
Jul 10 00:22:19.113349 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.113298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7" event={"ID":"99980b3a-db95-4a3b-913c-f2ff61e20c21","Type":"ContainerStarted","Data":"53f9bd8484f21a7e63d0ba199e44c2859b8d6887e7e956a405b22632415cf231"}
Jul 10 00:22:19.160032 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:19.159984    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f565978fc-7xhp7" podStartSLOduration=1.5940209429999999 podStartE2EDuration="4.159968313s" totalImagesPullingTime="2.56594737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:19.15790806 +0000 UTC m=+263.643199355" watchObservedRunningTime="2026-07-10 00:22:19.159968313 +0000 UTC m=+263.645259604"
Jul 10 00:22:22.337803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:22.337761    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" containerName="registry" containerID="cri-o://ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a" gracePeriod=30
Jul 10 00:22:22.942986 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:22.942954    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:22:23.072582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072561    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.072690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072621    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.072690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072649    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.072796 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072703    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhcsx\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.072964 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.073087 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:22:23.073087 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.072982    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.073224 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.073200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.073295 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.073268    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates\") pod \"970f6928-cfd3-4577-8279-a37651fd8a24\" (UID: \"970f6928-cfd3-4577-8279-a37651fd8a24\") "
Jul 10 00:22:23.073654 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.073562    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-trusted-ca\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.073982 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.073956    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:22:23.075653 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.075628    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx" (OuterVolumeSpecName: "kube-api-access-qhcsx") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "kube-api-access-qhcsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:22:23.075745 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.075625    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:22:23.076126 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.076094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:22:23.076230 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.076166    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:22:23.076292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.076232    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:22:23.081904 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.081880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "970f6928-cfd3-4577-8279-a37651fd8a24" (UID: "970f6928-cfd3-4577-8279-a37651fd8a24"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:22:23.131543 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.131511    2575 generic.go:356] "Generic (PLEG): container finished" podID="970f6928-cfd3-4577-8279-a37651fd8a24" containerID="ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a" exitCode=0
Jul 10 00:22:23.131698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.131566    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"
Jul 10 00:22:23.131698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.131598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" event={"ID":"970f6928-cfd3-4577-8279-a37651fd8a24","Type":"ContainerDied","Data":"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"}
Jul 10 00:22:23.131698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.131657    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbfd6d8b4-plzn2" event={"ID":"970f6928-cfd3-4577-8279-a37651fd8a24","Type":"ContainerDied","Data":"d5d046cc73d1d7428d6b7babafe84b041126c8d9d8c640de4f0778318f06caa9"}
Jul 10 00:22:23.131698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.131683    2575 scope.go:117] "RemoveContainer" containerID="ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"
Jul 10 00:22:23.134327 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.134301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"}
Jul 10 00:22:23.134425 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.134373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"}
Jul 10 00:22:23.141305 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.141181    2575 scope.go:117] "RemoveContainer" containerID="ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"
Jul 10 00:22:23.141625 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:22:23.141545    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a\": container with ID starting with ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a not found: ID does not exist" containerID="ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"
Jul 10 00:22:23.141625 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.141581    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a"} err="failed to get container status \"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a\": rpc error: code = NotFound desc = could not find container \"ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a\": container with ID starting with ea1f97d095f8596dc7d22723645d316e93f0c3c36e5fbe90029e428573d7760a not found: ID does not exist"
Jul 10 00:22:23.155048 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.155007    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:22:23.159029 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.159000    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fbfd6d8b4-plzn2"]
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174729    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-image-registry-private-configuration\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174762    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/970f6928-cfd3-4577-8279-a37651fd8a24-registry-certificates\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174779    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-registry-tls\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174794    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/970f6928-cfd3-4577-8279-a37651fd8a24-ca-trust-extracted\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174807    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhcsx\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-kube-api-access-qhcsx\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174820    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/970f6928-cfd3-4577-8279-a37651fd8a24-bound-sa-token\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:23.174932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:23.174851    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/970f6928-cfd3-4577-8279-a37651fd8a24-installation-pull-secrets\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:22:24.186241 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:24.186207    2575 scope.go:117] "RemoveContainer" containerID="1e089e18a79710a6cbc168a68fc1c875e0c924c7190269f77b86b976f0504c18"
Jul 10 00:22:24.191555 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:24.191533    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" path="/var/lib/kubelet/pods/970f6928-cfd3-4577-8279-a37651fd8a24/volumes"
Jul 10 00:22:25.146435 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:25.146401    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:22:25.146621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:25.146509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-9vgd4" event={"ID":"85c9c187-dc0b-4f7e-88fa-d856239bdb7f","Type":"ContainerStarted","Data":"dadf0041970e923ca7f1eded8e95d76e363dff66a7efa92f3806dd5d30d3eb87"}
Jul 10 00:22:25.146906 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:25.146880    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:22:25.153097 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:25.153072    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-9vgd4"
Jul 10 00:22:25.164707 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:25.164652    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-9vgd4" podStartSLOduration=55.433395381 podStartE2EDuration="57.164635169s" totalImagesPullingTime="1.731239788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:25.162515154 +0000 UTC m=+269.647806447" watchObservedRunningTime="2026-07-10 00:22:25.164635169 +0000 UTC m=+269.649926468"
Jul 10 00:22:26.154847 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.154793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"}
Jul 10 00:22:26.155209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.154893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"}
Jul 10 00:22:26.155209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.154928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"}
Jul 10 00:22:26.155209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.154959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerStarted","Data":"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"}
Jul 10 00:22:26.184138 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.184063    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.595937587 podStartE2EDuration="10.184046575s" totalImagesPullingTime="7.566150824s" totalInitContainerRuntime="21.958164ms" isStatefulPod=false podCreationTimestamp="2026-07-10 00:22:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:26.181653205 +0000 UTC m=+270.666944496" watchObservedRunningTime="2026-07-10 00:22:26.184046575 +0000 UTC m=+270.669337866"
Jul 10 00:22:26.347722 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:26.347686    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:22:34.457971 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:34.457927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:34.458362 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:34.457991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:37.752824 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:22:37.752773    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hw6tv" podUID="16fdeb06-489c-4076-b5ce-ee9bb619611b"
Jul 10 00:22:38.204087 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:38.204058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:41.331691 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:41.331657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:41.333999 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:41.333979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16fdeb06-489c-4076-b5ce-ee9bb619611b-metrics-tls\") pod \"dns-default-hw6tv\" (UID: \"16fdeb06-489c-4076-b5ce-ee9bb619611b\") " pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:41.507591 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:41.507561    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p75jv\""
Jul 10 00:22:41.515886 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:41.515860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:41.666077 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:41.666047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hw6tv"]
Jul 10 00:22:41.669512 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:22:41.669481    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fdeb06_489c_4076_b5ce_ee9bb619611b.slice/crio-eab3985e92488b07b93f02bbb281d3965e364be4d2f6cbbb45b8defdda50217c WatchSource:0}: Error finding container eab3985e92488b07b93f02bbb281d3965e364be4d2f6cbbb45b8defdda50217c: Status 404 returned error can't find the container with id eab3985e92488b07b93f02bbb281d3965e364be4d2f6cbbb45b8defdda50217c
Jul 10 00:22:42.219799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:42.219767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hw6tv" event={"ID":"16fdeb06-489c-4076-b5ce-ee9bb619611b","Type":"ContainerStarted","Data":"eab3985e92488b07b93f02bbb281d3965e364be4d2f6cbbb45b8defdda50217c"}
Jul 10 00:22:44.231291 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:44.231202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hw6tv" event={"ID":"16fdeb06-489c-4076-b5ce-ee9bb619611b","Type":"ContainerStarted","Data":"573c3cd63be666a4dbc98ad0bd0475743c779209aec7b691672460f4df2d81ab"}
Jul 10 00:22:44.231291 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:44.231257    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hw6tv" event={"ID":"16fdeb06-489c-4076-b5ce-ee9bb619611b","Type":"ContainerStarted","Data":"2a0bbfb1f2b8ab45a589d9521eff2dd71de98e4b89adc7dede04618c57e83054"}
Jul 10 00:22:44.231698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:44.231307    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:44.249383 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:44.249314    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hw6tv" podStartSLOduration=250.990241048 podStartE2EDuration="4m13.249297516s" totalImagesPullingTime="2.259056468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:22:44.24706726 +0000 UTC m=+288.732358551" watchObservedRunningTime="2026-07-10 00:22:44.249297516 +0000 UTC m=+288.734588806"
Jul 10 00:22:54.237435 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:54.237396    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hw6tv"
Jul 10 00:22:54.463594 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:54.463562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:54.467659 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:54.467635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65666bdb99-mkbxz"
Jul 10 00:22:55.933011 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:55.932980    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:22:55.934629 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:55.934608    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:22:55.942444 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:55.942424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:22:55.943827 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:55.943808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:22:55.945513 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:22:55.945492    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 00:23:16.348322 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:16.348283    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:16.370280 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:16.370233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:16.390327 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:16.390295    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:34.418418 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418377    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418671    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="prometheus" containerID="cri-o://5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24" gracePeriod=600
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418720    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-web" containerID="cri-o://a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a" gracePeriod=600
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418742    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="config-reloader" containerID="cri-o://cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0" gracePeriod=600
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418786    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479" gracePeriod=600
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418755    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="thanos-sidecar" containerID="cri-o://7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8" gracePeriod=600
Jul 10 00:23:34.419005 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:34.418771    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy" containerID="cri-o://61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f" gracePeriod=600
Jul 10 00:23:35.438638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438604    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479" exitCode=0
Jul 10 00:23:35.438638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438628    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f" exitCode=0
Jul 10 00:23:35.438638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438635    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8" exitCode=0
Jul 10 00:23:35.438638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438640    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0" exitCode=0
Jul 10 00:23:35.438638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438646    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24" exitCode=0
Jul 10 00:23:35.439141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"}
Jul 10 00:23:35.439141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"}
Jul 10 00:23:35.439141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"}
Jul 10 00:23:35.439141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"}
Jul 10 00:23:35.439141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.438846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"}
Jul 10 00:23:35.673530 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.673504    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:35.797799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797703    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.797799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.797799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797765    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.797799 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797800    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797822    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797952    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.797977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798016    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798041    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798153 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798120    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvlws\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798214    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798295    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798328    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798352    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"010d7774-3316-4384-9a70-dfbabe078da3\" (UID: \"010d7774-3316-4384-9a70-dfbabe078da3\") "
Jul 10 00:23:35.798614 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.798608    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.799208 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.799179    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:23:35.799712 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.799683    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.799818 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.799790    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.800118 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800091    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.800359 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800291    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.801123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800516    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.801123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.801123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800736    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 00:23:35.801123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.800812    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config" (OuterVolumeSpecName: "config") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.801123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.801106    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.801859 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.801805    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out" (OuterVolumeSpecName: "config-out") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:23:35.802372 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.802336    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.802803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.802776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.803229 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.803194    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:23:35.803322 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.803281    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.803562 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.803528    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.803665 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.803561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws" (OuterVolumeSpecName: "kube-api-access-bvlws") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "kube-api-access-bvlws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:23:35.804065 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.804042    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.813101 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.813078    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config" (OuterVolumeSpecName: "web-config") pod "010d7774-3316-4384-9a70-dfbabe078da3" (UID: "010d7774-3316-4384-9a70-dfbabe078da3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:23:35.899718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899682    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-grpc-tls\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899715    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899726    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899735    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-metrics-client-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899746    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899756    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-kube-rbac-proxy\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899764    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-web-config\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899772    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-metrics-client-ca\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899780    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-tls-assets\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899787    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvlws\" (UniqueName: \"kubernetes.io/projected/010d7774-3316-4384-9a70-dfbabe078da3-kube-api-access-bvlws\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899795    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899804    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899813    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899821    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899829    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899869    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899885    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/010d7774-3316-4384-9a70-dfbabe078da3-config\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899894    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-prometheus-k8s-db\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:35.899967 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:35.899904    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/010d7774-3316-4384-9a70-dfbabe078da3-config-out\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:23:36.445383 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.445349    2575 generic.go:356] "Generic (PLEG): container finished" podID="010d7774-3316-4384-9a70-dfbabe078da3" containerID="a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a" exitCode=0
Jul 10 00:23:36.445745 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.445432    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.445745 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.445430    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"}
Jul 10 00:23:36.445745 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.445573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"010d7774-3316-4384-9a70-dfbabe078da3","Type":"ContainerDied","Data":"bd1018e04afe03c802ce042caf9b93fa857f9b6ef316d84256d9eab52d082f41"}
Jul 10 00:23:36.445745 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.445606    2575 scope.go:117] "RemoveContainer" containerID="8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"
Jul 10 00:23:36.453263 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.453244    2575 scope.go:117] "RemoveContainer" containerID="61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"
Jul 10 00:23:36.460306 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.460286    2575 scope.go:117] "RemoveContainer" containerID="a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"
Jul 10 00:23:36.466883 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.466866    2575 scope.go:117] "RemoveContainer" containerID="7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"
Jul 10 00:23:36.468570 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.468552    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:36.473643 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.473619    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:36.480589 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.480564    2575 scope.go:117] "RemoveContainer" containerID="cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"
Jul 10 00:23:36.487790 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.487767    2575 scope.go:117] "RemoveContainer" containerID="5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"
Jul 10 00:23:36.494913 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.494890    2575 scope.go:117] "RemoveContainer" containerID="7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b"
Jul 10 00:23:36.500937 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.500917    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:36.501177 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501165    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-web"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501178    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-web"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501194    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="init-config-reloader"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501199    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="init-config-reloader"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501206    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="config-reloader"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501213    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="config-reloader"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501220    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" containerName="registry"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501225    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" containerName="registry"
Jul 10 00:23:36.501231 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501232    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="thanos-sidecar"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501238    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="thanos-sidecar"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501244    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501249    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501255    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-thanos"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501262    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-thanos"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501267    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="prometheus"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501272    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="prometheus"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501317    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="970f6928-cfd3-4577-8279-a37651fd8a24" containerName="registry"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501323    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501328    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="config-reloader"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501336    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-web"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501342    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="thanos-sidecar"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501349    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="prometheus"
Jul 10 00:23:36.501517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.501354    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="010d7774-3316-4384-9a70-dfbabe078da3" containerName="kube-rbac-proxy-thanos"
Jul 10 00:23:36.502377 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.502352    2575 scope.go:117] "RemoveContainer" containerID="8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"
Jul 10 00:23:36.502662 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.502642    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479\": container with ID starting with 8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479 not found: ID does not exist" containerID="8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"
Jul 10 00:23:36.502718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.502671    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479"} err="failed to get container status \"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479\": rpc error: code = NotFound desc = could not find container \"8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479\": container with ID starting with 8f66de14aecbe324b4405ffc4c27f8b1dbd409adc2e477ea041d7cc5192ef479 not found: ID does not exist"
Jul 10 00:23:36.502718 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.502691    2575 scope.go:117] "RemoveContainer" containerID="61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"
Jul 10 00:23:36.502944 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.502926    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f\": container with ID starting with 61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f not found: ID does not exist" containerID="61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"
Jul 10 00:23:36.502990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.502950    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f"} err="failed to get container status \"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f\": rpc error: code = NotFound desc = could not find container \"61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f\": container with ID starting with 61daf8d562aa526dd3fe98b98406d9cc823f8a22e2d5b82cc47e225e4736966f not found: ID does not exist"
Jul 10 00:23:36.502990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.502965    2575 scope.go:117] "RemoveContainer" containerID="a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"
Jul 10 00:23:36.503157 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.503142    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a\": container with ID starting with a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a not found: ID does not exist" containerID="a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"
Jul 10 00:23:36.503198 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503161    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a"} err="failed to get container status \"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a\": rpc error: code = NotFound desc = could not find container \"a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a\": container with ID starting with a7802a98bb7ec4319f577db7bc7be2a519affb9a113f6691c99dad0e794c896a not found: ID does not exist"
Jul 10 00:23:36.503198 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503173    2575 scope.go:117] "RemoveContainer" containerID="7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"
Jul 10 00:23:36.503365 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.503350    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8\": container with ID starting with 7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8 not found: ID does not exist" containerID="7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"
Jul 10 00:23:36.503403 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503367    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8"} err="failed to get container status \"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8\": rpc error: code = NotFound desc = could not find container \"7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8\": container with ID starting with 7849bb035120f41633883a1d31ac845065101a925893168108b4a0d718e0adc8 not found: ID does not exist"
Jul 10 00:23:36.503403 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503379    2575 scope.go:117] "RemoveContainer" containerID="cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"
Jul 10 00:23:36.503580 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.503563    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0\": container with ID starting with cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0 not found: ID does not exist" containerID="cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"
Jul 10 00:23:36.503621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503585    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0"} err="failed to get container status \"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0\": rpc error: code = NotFound desc = could not find container \"cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0\": container with ID starting with cefbb63f500240a95d974ba1060030b0615872506884e38a165e6242a8b4e9d0 not found: ID does not exist"
Jul 10 00:23:36.503621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503599    2575 scope.go:117] "RemoveContainer" containerID="5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"
Jul 10 00:23:36.503861 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.503827    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24\": container with ID starting with 5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24 not found: ID does not exist" containerID="5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"
Jul 10 00:23:36.503927 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503863    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24"} err="failed to get container status \"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24\": rpc error: code = NotFound desc = could not find container \"5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24\": container with ID starting with 5fc1359ac48af57964e8beb61a1ee95247a211c7ce18e10d81110d65f892db24 not found: ID does not exist"
Jul 10 00:23:36.503927 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.503876    2575 scope.go:117] "RemoveContainer" containerID="7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b"
Jul 10 00:23:36.504090 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:23:36.504073    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b\": container with ID starting with 7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b not found: ID does not exist" containerID="7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b"
Jul 10 00:23:36.504129 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.504094    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b"} err="failed to get container status \"7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b\": rpc error: code = NotFound desc = could not find container \"7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b\": container with ID starting with 7e1e9574a21d59eed5fdb5290796f3751eef564a3538d57d3698ac819729cd7b not found: ID does not exist"
Jul 10 00:23:36.506538 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.506524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.509280 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509260    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5kgdgvogbce0e\""
Jul 10 00:23:36.509387 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509317    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 00:23:36.509387 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 00:23:36.509387 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509363    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 00:23:36.509387 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 00:23:36.509685 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509667    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 00:23:36.509810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509793    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 00:23:36.509899 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509798    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 00:23:36.509899 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 00:23:36.509899 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509872    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 00:23:36.510061 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.509953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s8c5s\""
Jul 10 00:23:36.510061 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.510017    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 00:23:36.510207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.510191    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 00:23:36.510519 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.510499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 00:23:36.513185 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.513166    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 00:23:36.516283 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.516265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 00:23:36.524802 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.524781    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:36.604870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.604870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.604959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-kube-api-access-c5f94\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605303 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.605607 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.605311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706199 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706199 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706199 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-kube-api-access-c5f94\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.706809 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.706771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.707392 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.707057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.707392 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.707189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.707392 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.707326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.707692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.707986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.709211    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.709426    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.709577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.709716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.709707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.710226 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.710197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.711063 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.710930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.711457 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.711433    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712236 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712236 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d806529-1357-40f8-8efd-dfe56b006dc4-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712236 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-config\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712441 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d806529-1357-40f8-8efd-dfe56b006dc4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712502 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712484    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d806529-1357-40f8-8efd-dfe56b006dc4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.712776 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.712756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.715992 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.715971    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5f94\" (UniqueName: \"kubernetes.io/projected/1d806529-1357-40f8-8efd-dfe56b006dc4-kube-api-access-c5f94\") pod \"prometheus-k8s-0\" (UID: \"1d806529-1357-40f8-8efd-dfe56b006dc4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.817188 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.817140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:23:36.957689 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:36.957519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 00:23:36.960328 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:23:36.960296    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d806529_1357_40f8_8efd_dfe56b006dc4.slice/crio-3f747adc997d14f88aa2e91a416132ad9d797ba745cbdb9bb74910fc0df327c6 WatchSource:0}: Error finding container 3f747adc997d14f88aa2e91a416132ad9d797ba745cbdb9bb74910fc0df327c6: Status 404 returned error can't find the container with id 3f747adc997d14f88aa2e91a416132ad9d797ba745cbdb9bb74910fc0df327c6
Jul 10 00:23:37.451449 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:37.451416    2575 generic.go:356] "Generic (PLEG): container finished" podID="1d806529-1357-40f8-8efd-dfe56b006dc4" containerID="1851f4ef67dd29b2025a538d88dbae3613552d5040ed2d1eb96f5f6af3f6ae43" exitCode=0
Jul 10 00:23:37.451884 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:37.451506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerDied","Data":"1851f4ef67dd29b2025a538d88dbae3613552d5040ed2d1eb96f5f6af3f6ae43"}
Jul 10 00:23:37.451884 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:37.451620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"3f747adc997d14f88aa2e91a416132ad9d797ba745cbdb9bb74910fc0df327c6"}
Jul 10 00:23:38.191607 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.191572    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010d7774-3316-4384-9a70-dfbabe078da3" path="/var/lib/kubelet/pods/010d7774-3316-4384-9a70-dfbabe078da3/volumes"
Jul 10 00:23:38.459829 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"ab0075aff7ec5b7b1fadb8bd28cb075c562abcba5e909d08195695e450ec322f"}
Jul 10 00:23:38.460292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"ed29af4261d6cf4bf4dcda6d6f385888539221df8a0bde85a56edec0ff7930e5"}
Jul 10 00:23:38.460292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"f2a222ff4e08f9a2019a85ae85eccf2226e0adf30bc58145cc44643419671fa2"}
Jul 10 00:23:38.460292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"113cb51113d6aaa9fc7e89c98fda03b9c9998c17f6db2cc5337c61934dd537a5"}
Jul 10 00:23:38.460292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"f376e6afdef4db39c6e6df4e5d6f1c916082b265afd1ad9e4a3d2d80c064a8ad"}
Jul 10 00:23:38.460292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.459971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d806529-1357-40f8-8efd-dfe56b006dc4","Type":"ContainerStarted","Data":"e946747006551d187b33f447fe9397add2895c8397e565c26de45ba2d340820b"}
Jul 10 00:23:38.515083 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:38.515024    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.497537487 podStartE2EDuration="2.515007474s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.469987ms" isStatefulPod=false podCreationTimestamp="2026-07-10 00:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:23:38.513669194 +0000 UTC m=+342.998960487" watchObservedRunningTime="2026-07-10 00:23:38.515007474 +0000 UTC m=+343.000298764"
Jul 10 00:23:41.817726 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:23:41.817675    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:24:36.818052 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:24:36.818000    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:24:36.833310 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:24:36.833286    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:24:37.697815 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:24:37.697789    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 00:25:26.544689 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.544604    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"]
Jul 10 00:25:26.548062 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.548041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.551925 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.551901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 00:25:26.552141 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.552126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-htlhs\""
Jul 10 00:25:26.552226 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.552200    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 00:25:26.552286 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.552248    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 00:25:26.552286 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.552257    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 00:25:26.552286 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.552267    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 00:25:26.558457 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.558435    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"]
Jul 10 00:25:26.717807 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.717769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.717807 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.717815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-metrics-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.718019 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.717871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4jj\" (UniqueName: \"kubernetes.io/projected/d0912047-cb74-4b54-9cdc-cc2ae2b46693-kube-api-access-9b4jj\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.718019 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.717986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0912047-cb74-4b54-9cdc-cc2ae2b46693-manager-config\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.818420 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.818328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.818420 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.818377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-metrics-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.818420 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.818401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4jj\" (UniqueName: \"kubernetes.io/projected/d0912047-cb74-4b54-9cdc-cc2ae2b46693-kube-api-access-9b4jj\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.818686 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.818477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0912047-cb74-4b54-9cdc-cc2ae2b46693-manager-config\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.819192 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.819169    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0912047-cb74-4b54-9cdc-cc2ae2b46693-manager-config\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.820917 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.820894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-metrics-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.820998 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.820930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0912047-cb74-4b54-9cdc-cc2ae2b46693-cert\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.831449 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.831423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4jj\" (UniqueName: \"kubernetes.io/projected/d0912047-cb74-4b54-9cdc-cc2ae2b46693-kube-api-access-9b4jj\") pod \"lws-controller-manager-56d4fb96db-pp9gz\" (UID: \"d0912047-cb74-4b54-9cdc-cc2ae2b46693\") " pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.857853 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.857810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:26.997163 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:26.997138    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"]
Jul 10 00:25:26.999977 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:25:26.999949    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0912047_cb74_4b54_9cdc_cc2ae2b46693.slice/crio-784af67d7401013676cd5fe910b6ed157f1c21a0e9011dad7b25ff69e69142d1 WatchSource:0}: Error finding container 784af67d7401013676cd5fe910b6ed157f1c21a0e9011dad7b25ff69e69142d1: Status 404 returned error can't find the container with id 784af67d7401013676cd5fe910b6ed157f1c21a0e9011dad7b25ff69e69142d1
Jul 10 00:25:27.001896 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:27.001879    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 00:25:27.872398 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:27.872356    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz" event={"ID":"d0912047-cb74-4b54-9cdc-cc2ae2b46693","Type":"ContainerStarted","Data":"784af67d7401013676cd5fe910b6ed157f1c21a0e9011dad7b25ff69e69142d1"}
Jul 10 00:25:29.884445 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:29.884406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz" event={"ID":"d0912047-cb74-4b54-9cdc-cc2ae2b46693","Type":"ContainerStarted","Data":"578a60c344946577ffa85349df1686d3629ae76a88266eaa0fa72566ca7f9a64"}
Jul 10 00:25:29.884868 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:29.884550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:29.903949 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:29.903899    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz" podStartSLOduration=1.498288818 podStartE2EDuration="3.903884097s" totalImagesPullingTime="2.405595279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:25:29.902362107 +0000 UTC m=+454.387653394" watchObservedRunningTime="2026-07-10 00:25:29.903884097 +0000 UTC m=+454.389175388"
Jul 10 00:25:40.890503 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:40.890471    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56d4fb96db-pp9gz"
Jul 10 00:25:46.205346 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.205312    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"]
Jul 10 00:25:46.210474 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.210457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.226098 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.226076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 00:25:46.226222 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.226098    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 00:25:46.226222 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.226191    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jktj7\""
Jul 10 00:25:46.226347 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.226278    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 00:25:46.226347 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.226321    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 00:25:46.255227 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.255199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"]
Jul 10 00:25:46.258942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.258912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.259073 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.258960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.259073 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.258980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-tmp\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.259073 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.259022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-manifests\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.259073 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.259047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9vr7\" (UniqueName: \"kubernetes.io/projected/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-kube-api-access-g9vr7\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359426 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359426 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-tmp\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359640 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-manifests\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359640 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9vr7\" (UniqueName: \"kubernetes.io/projected/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-kube-api-access-g9vr7\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359640 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.359907 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.359884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-manifests\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.361851 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.361818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-tmp\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.361969 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.361936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.362028 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.362011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.367635 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.367617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9vr7\" (UniqueName: \"kubernetes.io/projected/f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19-kube-api-access-g9vr7\") pod \"opendatahub-operator-controller-manager-85d875657f-lsrnl\" (UID: \"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19\") " pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.520583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.520468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:46.652992 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.652967    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"]
Jul 10 00:25:46.655482 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:25:46.655449    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c36d4b_1bcf_46b0_9453_6c2f2aa54f19.slice/crio-cc6446a4dc189a5f68b21f6edf320ff162ae6fede2fa46aa1389ab17070d0a7d WatchSource:0}: Error finding container cc6446a4dc189a5f68b21f6edf320ff162ae6fede2fa46aa1389ab17070d0a7d: Status 404 returned error can't find the container with id cc6446a4dc189a5f68b21f6edf320ff162ae6fede2fa46aa1389ab17070d0a7d
Jul 10 00:25:46.955264 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:46.955223    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl" event={"ID":"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19","Type":"ContainerStarted","Data":"cc6446a4dc189a5f68b21f6edf320ff162ae6fede2fa46aa1389ab17070d0a7d"}
Jul 10 00:25:49.970326 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:49.970233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl" event={"ID":"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19","Type":"ContainerStarted","Data":"06bc3e559fdb8604b1a140fc046f63d064c6669398a935fdbfba480b30e42944"}
Jul 10 00:25:50.975542 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:50.975508    2575 generic.go:356] "Generic (PLEG): container finished" podID="f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19" containerID="06bc3e559fdb8604b1a140fc046f63d064c6669398a935fdbfba480b30e42944" exitCode=0
Jul 10 00:25:50.975926 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:50.975595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl" event={"ID":"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19","Type":"ContainerDied","Data":"06bc3e559fdb8604b1a140fc046f63d064c6669398a935fdbfba480b30e42944"}
Jul 10 00:25:51.981575 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:51.981545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl" event={"ID":"f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19","Type":"ContainerStarted","Data":"7e6b1c3dda782e352610b037d541d7859315af0114dc7372df5476c23ad776e8"}
Jul 10 00:25:51.982093 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:51.981676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:25:52.005277 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:25:52.005224    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl" podStartSLOduration=1.474272414 podStartE2EDuration="6.005204422s" totalImagesPullingTime="3.460597956s" totalInitContainerRuntime="1.070334052s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:25:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:25:52.004797981 +0000 UTC m=+476.490089275" watchObservedRunningTime="2026-07-10 00:25:52.005204422 +0000 UTC m=+476.490495712"
Jul 10 00:26:02.993880 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:02.993826    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85d875657f-lsrnl"
Jul 10 00:26:15.992735 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:15.992706    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"]
Jul 10 00:26:16.001795 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.001774    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.004641 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.004620    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 00:26:16.004757 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.004676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 00:26:16.005992 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.005972    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 00:26:16.006123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.005977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 00:26:16.006123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.005981    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mzggw\""
Jul 10 00:26:16.011636 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.011616    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"]
Jul 10 00:26:16.115024 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.114993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tmp\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.115187 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.115044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt6xw\" (UniqueName: \"kubernetes.io/projected/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-kube-api-access-pt6xw\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.115187 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.115110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tls-certs\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.216006 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.215968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt6xw\" (UniqueName: \"kubernetes.io/projected/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-kube-api-access-pt6xw\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.216194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.216038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tls-certs\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.216194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.216081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tmp\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.218326 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.218294    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tmp\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.218556 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.218535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-tls-certs\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.227271 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.227244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt6xw\" (UniqueName: \"kubernetes.io/projected/c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3-kube-api-access-pt6xw\") pod \"kube-auth-proxy-77865f7b8-srmxg\" (UID: \"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3\") " pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.312658 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.312579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"
Jul 10 00:26:16.439876 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:16.439823    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77865f7b8-srmxg"]
Jul 10 00:26:16.442979 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:26:16.442950    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ee5f17_e7f9_4421_ba8c_0a6932aa8ac3.slice/crio-a98e3d055cf0d58566c5ff7c860a6c12029d0757e2227e5f24d4fadf80475fdb WatchSource:0}: Error finding container a98e3d055cf0d58566c5ff7c860a6c12029d0757e2227e5f24d4fadf80475fdb: Status 404 returned error can't find the container with id a98e3d055cf0d58566c5ff7c860a6c12029d0757e2227e5f24d4fadf80475fdb
Jul 10 00:26:17.096063 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:17.096024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg" event={"ID":"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3","Type":"ContainerStarted","Data":"a98e3d055cf0d58566c5ff7c860a6c12029d0757e2227e5f24d4fadf80475fdb"}
Jul 10 00:26:20.113143 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:20.113060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg" event={"ID":"c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3","Type":"ContainerStarted","Data":"ffdffbcaf86d92b00f18cf0c7bf7f58b11e6ace64f46822096b7883ed4b5f3ad"}
Jul 10 00:26:20.129826 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:26:20.129772    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77865f7b8-srmxg" podStartSLOduration=1.822067586 podStartE2EDuration="5.129755112s" totalImagesPullingTime="3.307687526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:26:20.128622435 +0000 UTC m=+504.613913728" watchObservedRunningTime="2026-07-10 00:26:20.129755112 +0000 UTC m=+504.615046437"
Jul 10 00:27:49.305201 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.305169    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"]
Jul 10 00:27:49.307369 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.307348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.310114 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.310092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 00:27:49.310244 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.310094    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 00:27:49.310376 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.310356    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 00:27:49.310416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.310370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lc6p2\""
Jul 10 00:27:49.311518 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.311499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 00:27:49.316450 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.316427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"]
Jul 10 00:27:49.405355 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.405327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv765\" (UniqueName: \"kubernetes.io/projected/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-kube-api-access-jv765\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.405560 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.405397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.405560 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.405434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.506051 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.506016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv765\" (UniqueName: \"kubernetes.io/projected/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-kube-api-access-jv765\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.506269 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.506123    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.506269 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.506163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.506401 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:27:49.506288    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 10 00:27:49.506401 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:27:49.506373    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert podName:54205b1e-e77d-4fb5-bfc9-38dbb6b1625b nodeName:}" failed. No retries permitted until 2026-07-10 00:27:50.006338528 +0000 UTC m=+594.491629800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-kjcqz" (UID: "54205b1e-e77d-4fb5-bfc9-38dbb6b1625b") : secret "plugin-serving-cert" not found
Jul 10 00:27:49.506795 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.506773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:49.515083 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:49.515059    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv765\" (UniqueName: \"kubernetes.io/projected/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-kube-api-access-jv765\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:50.011206 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:50.011171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:50.013771 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:50.013744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/54205b1e-e77d-4fb5-bfc9-38dbb6b1625b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-kjcqz\" (UID: \"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:50.232283 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:50.232251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"
Jul 10 00:27:50.357570 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:50.357358    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz"]
Jul 10 00:27:50.359479 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:27:50.359455    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54205b1e_e77d_4fb5_bfc9_38dbb6b1625b.slice/crio-77d01e67e5a4fb837c9207a7a9473b235cd39440193ac32b6f2d438e30238f2a WatchSource:0}: Error finding container 77d01e67e5a4fb837c9207a7a9473b235cd39440193ac32b6f2d438e30238f2a: Status 404 returned error can't find the container with id 77d01e67e5a4fb837c9207a7a9473b235cd39440193ac32b6f2d438e30238f2a
Jul 10 00:27:50.487428 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:50.487391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz" event={"ID":"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b","Type":"ContainerStarted","Data":"77d01e67e5a4fb837c9207a7a9473b235cd39440193ac32b6f2d438e30238f2a"}
Jul 10 00:27:56.042596 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:56.042559    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:27:56.043328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:56.043308    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:27:56.054081 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:56.054053    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:27:56.054390 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:27:56.054371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:28:14.601297 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:14.601208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz" event={"ID":"54205b1e-e77d-4fb5-bfc9-38dbb6b1625b","Type":"ContainerStarted","Data":"b9fd7e236c919f4cbba2df28d4f3f942d39a54937a0fd28b7cf2002f2f9047c0"}
Jul 10 00:28:14.617942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:14.617862    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-kjcqz" podStartSLOduration=1.714187714 podStartE2EDuration="25.617816725s" totalImagesPullingTime="23.903629011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:28:14.617334416 +0000 UTC m=+619.102625707" watchObservedRunningTime="2026-07-10 00:28:14.617816725 +0000 UTC m=+619.103108016"
Jul 10 00:28:45.023603 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.023570    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:28:45.100618 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.100582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:28:45.100618 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.100619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:28:45.100993 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.100739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.103496 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.103477    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 00:28:45.199258 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.199226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltv8\" (UniqueName: \"kubernetes.io/projected/df26d271-6f50-49da-8571-f63c9bac23aa-kube-api-access-dltv8\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.199431 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.199306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df26d271-6f50-49da-8571-f63c9bac23aa-config-file\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.300209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.300113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df26d271-6f50-49da-8571-f63c9bac23aa-config-file\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.300209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.300166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltv8\" (UniqueName: \"kubernetes.io/projected/df26d271-6f50-49da-8571-f63c9bac23aa-kube-api-access-dltv8\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.300806 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.300787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df26d271-6f50-49da-8571-f63c9bac23aa-config-file\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.309876 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.309847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltv8\" (UniqueName: \"kubernetes.io/projected/df26d271-6f50-49da-8571-f63c9bac23aa-kube-api-access-dltv8\") pod \"limitador-limitador-54d6d988d5-kzp67\" (UID: \"df26d271-6f50-49da-8571-f63c9bac23aa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.411651 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.411621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:45.542116 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.542090    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:28:45.544798 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:28:45.544765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf26d271_6f50_49da_8571_f63c9bac23aa.slice/crio-d141b9c5b97f85db2aaab0f309118ae82d05cb05ecf2f1f2ec9c84c29c9cae81 WatchSource:0}: Error finding container d141b9c5b97f85db2aaab0f309118ae82d05cb05ecf2f1f2ec9c84c29c9cae81: Status 404 returned error can't find the container with id d141b9c5b97f85db2aaab0f309118ae82d05cb05ecf2f1f2ec9c84c29c9cae81
Jul 10 00:28:45.642977 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.642894    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:28:45.646273 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.646251    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:28:45.648632 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.648615    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dllv7\""
Jul 10 00:28:45.652882 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.652861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:28:45.704168 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.704125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff6km\" (UniqueName: \"kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km\") pod \"authorino-75d556bd77-bjk5x\" (UID: \"352961e5-09d7-44e9-992b-cfe221b6619c\") " pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:28:45.734192 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.734156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67" event={"ID":"df26d271-6f50-49da-8571-f63c9bac23aa","Type":"ContainerStarted","Data":"d141b9c5b97f85db2aaab0f309118ae82d05cb05ecf2f1f2ec9c84c29c9cae81"}
Jul 10 00:28:45.805429 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.805398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff6km\" (UniqueName: \"kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km\") pod \"authorino-75d556bd77-bjk5x\" (UID: \"352961e5-09d7-44e9-992b-cfe221b6619c\") " pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:28:45.813621 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.813596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff6km\" (UniqueName: \"kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km\") pod \"authorino-75d556bd77-bjk5x\" (UID: \"352961e5-09d7-44e9-992b-cfe221b6619c\") " pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:28:45.957207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:45.957171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:28:46.091698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:46.091660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:28:46.095788 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:28:46.095754    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod352961e5_09d7_44e9_992b_cfe221b6619c.slice/crio-9ba6e8b425aeb98ff7e07df6e83f296cccb147c529376525fe0fd60c598d4e5e WatchSource:0}: Error finding container 9ba6e8b425aeb98ff7e07df6e83f296cccb147c529376525fe0fd60c598d4e5e: Status 404 returned error can't find the container with id 9ba6e8b425aeb98ff7e07df6e83f296cccb147c529376525fe0fd60c598d4e5e
Jul 10 00:28:46.744209 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:46.744163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bjk5x" event={"ID":"352961e5-09d7-44e9-992b-cfe221b6619c","Type":"ContainerStarted","Data":"9ba6e8b425aeb98ff7e07df6e83f296cccb147c529376525fe0fd60c598d4e5e"}
Jul 10 00:28:50.764588 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:50.764549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bjk5x" event={"ID":"352961e5-09d7-44e9-992b-cfe221b6619c","Type":"ContainerStarted","Data":"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"}
Jul 10 00:28:50.766043 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:50.766017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67" event={"ID":"df26d271-6f50-49da-8571-f63c9bac23aa","Type":"ContainerStarted","Data":"8b07633be3659fb13e9cae84a08dc0b363ba23cccafd988175f0fb983ffd7f66"}
Jul 10 00:28:50.766157 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:50.766142    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:28:50.779027 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:50.778983    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bjk5x" podStartSLOduration=1.950412052 podStartE2EDuration="5.778970532s" totalImagesPullingTime="3.82855848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:28:50.778133486 +0000 UTC m=+655.263424776" watchObservedRunningTime="2026-07-10 00:28:50.778970532 +0000 UTC m=+655.264261823"
Jul 10 00:28:50.794145 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:28:50.794101    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67" podStartSLOduration=1.417887672 podStartE2EDuration="5.794085586s" totalImagesPullingTime="4.376197914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:28:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:28:50.792819617 +0000 UTC m=+655.278110924" watchObservedRunningTime="2026-07-10 00:28:50.794085586 +0000 UTC m=+655.279376882"
Jul 10 00:29:01.772009 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:01.771977    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kzp67"
Jul 10 00:29:19.813485 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:19.813451    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jt8rr"]
Jul 10 00:29:19.876454 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:19.876421    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jt8rr"]
Jul 10 00:29:19.876613 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:19.876516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:20.011235 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.011192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd77t\" (UniqueName: \"kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t\") pod \"authorino-5d4b67c446-jt8rr\" (UID: \"dea53177-6894-47b2-aee6-7dae5db69d2e\") " pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:20.063077 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.063047    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jt8rr"]
Jul 10 00:29:20.063300 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:29:20.063279    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gd77t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jt8rr" podUID="dea53177-6894-47b2-aee6-7dae5db69d2e"
Jul 10 00:29:20.087460 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.087401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:29:20.112698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.112668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd77t\" (UniqueName: \"kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t\") pod \"authorino-5d4b67c446-jt8rr\" (UID: \"dea53177-6894-47b2-aee6-7dae5db69d2e\") " pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:20.119827 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.119801    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:29:20.119961 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.119903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.120486 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.120467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd77t\" (UniqueName: \"kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t\") pod \"authorino-5d4b67c446-jt8rr\" (UID: \"dea53177-6894-47b2-aee6-7dae5db69d2e\") " pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:20.122519 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.122503    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 00:29:20.213322 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.213293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.213478 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.213353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk8hb\" (UniqueName: \"kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.314678 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.314649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk8hb\" (UniqueName: \"kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.314946 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.314919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.317251 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.317230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.322187 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.322166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk8hb\" (UniqueName: \"kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb\") pod \"authorino-746fbff54b-2t6fv\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") " pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.436024 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.435995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:29:20.569575 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.569415    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:29:20.572272 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:29:20.572245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30d46611_123d_4511_8389_3d88699cc211.slice/crio-42e19d2490c79f61af67af10bb39806096ccb5d0cbc4a6f7411db2a25858836b WatchSource:0}: Error finding container 42e19d2490c79f61af67af10bb39806096ccb5d0cbc4a6f7411db2a25858836b: Status 404 returned error can't find the container with id 42e19d2490c79f61af67af10bb39806096ccb5d0cbc4a6f7411db2a25858836b
Jul 10 00:29:20.905445 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.905377    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:20.905810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.905378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-746fbff54b-2t6fv" event={"ID":"30d46611-123d-4511-8389-3d88699cc211","Type":"ContainerStarted","Data":"42e19d2490c79f61af67af10bb39806096ccb5d0cbc4a6f7411db2a25858836b"}
Jul 10 00:29:20.922590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:20.922569    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:21.020767 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.020739    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd77t\" (UniqueName: \"kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t\") pod \"dea53177-6894-47b2-aee6-7dae5db69d2e\" (UID: \"dea53177-6894-47b2-aee6-7dae5db69d2e\") "
Jul 10 00:29:21.022740 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.022720    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t" (OuterVolumeSpecName: "kube-api-access-gd77t") pod "dea53177-6894-47b2-aee6-7dae5db69d2e" (UID: "dea53177-6894-47b2-aee6-7dae5db69d2e"). InnerVolumeSpecName "kube-api-access-gd77t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:29:21.121982 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.121960    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd77t\" (UniqueName: \"kubernetes.io/projected/dea53177-6894-47b2-aee6-7dae5db69d2e-kube-api-access-gd77t\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:29:21.911697 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.911669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jt8rr"
Jul 10 00:29:21.911697 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.911664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-746fbff54b-2t6fv" event={"ID":"30d46611-123d-4511-8389-3d88699cc211","Type":"ContainerStarted","Data":"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"}
Jul 10 00:29:21.929889 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.929818    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-746fbff54b-2t6fv" podStartSLOduration=1.464539709 podStartE2EDuration="1.929801026s" totalImagesPullingTime="465.261317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:29:21.929115497 +0000 UTC m=+686.414406801" watchObservedRunningTime="2026-07-10 00:29:21.929801026 +0000 UTC m=+686.415092316"
Jul 10 00:29:21.956704 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.956667    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jt8rr"]
Jul 10 00:29:21.964414 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.964380    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:29:21.964679 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.964650    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bjk5x" podUID="352961e5-09d7-44e9-992b-cfe221b6619c" containerName="authorino" containerID="cri-o://ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35" gracePeriod=30
Jul 10 00:29:21.967091 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:21.967066    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jt8rr"]
Jul 10 00:29:22.191514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.191481    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dea53177-6894-47b2-aee6-7dae5db69d2e" path="/var/lib/kubelet/pods/dea53177-6894-47b2-aee6-7dae5db69d2e/volumes"
Jul 10 00:29:22.223022 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.223000    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:29:22.333463 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.333426    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff6km\" (UniqueName: \"kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km\") pod \"352961e5-09d7-44e9-992b-cfe221b6619c\" (UID: \"352961e5-09d7-44e9-992b-cfe221b6619c\") "
Jul 10 00:29:22.335584 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.335559    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km" (OuterVolumeSpecName: "kube-api-access-ff6km") pod "352961e5-09d7-44e9-992b-cfe221b6619c" (UID: "352961e5-09d7-44e9-992b-cfe221b6619c"). InnerVolumeSpecName "kube-api-access-ff6km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:29:22.435123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.435088    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff6km\" (UniqueName: \"kubernetes.io/projected/352961e5-09d7-44e9-992b-cfe221b6619c-kube-api-access-ff6km\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:29:22.917100 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.917064    2575 generic.go:356] "Generic (PLEG): container finished" podID="352961e5-09d7-44e9-992b-cfe221b6619c" containerID="ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35" exitCode=0
Jul 10 00:29:22.917583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.917116    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bjk5x"
Jul 10 00:29:22.917583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.917157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bjk5x" event={"ID":"352961e5-09d7-44e9-992b-cfe221b6619c","Type":"ContainerDied","Data":"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"}
Jul 10 00:29:22.917583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.917202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bjk5x" event={"ID":"352961e5-09d7-44e9-992b-cfe221b6619c","Type":"ContainerDied","Data":"9ba6e8b425aeb98ff7e07df6e83f296cccb147c529376525fe0fd60c598d4e5e"}
Jul 10 00:29:22.917583 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.917220    2575 scope.go:117] "RemoveContainer" containerID="ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"
Jul 10 00:29:22.925936 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.925914    2575 scope.go:117] "RemoveContainer" containerID="ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"
Jul 10 00:29:22.926214 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:29:22.926197    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35\": container with ID starting with ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35 not found: ID does not exist" containerID="ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"
Jul 10 00:29:22.926274 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.926223    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35"} err="failed to get container status \"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35\": rpc error: code = NotFound desc = could not find container \"ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35\": container with ID starting with ef9c669f8eddb75ac921708fb8039b0ed64acb8a62dfc5409444f3ec1ecd0e35 not found: ID does not exist"
Jul 10 00:29:22.937365 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.937341    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:29:22.939779 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:22.939758    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bjk5x"]
Jul 10 00:29:24.190789 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:29:24.190748    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="352961e5-09d7-44e9-992b-cfe221b6619c" path="/var/lib/kubelet/pods/352961e5-09d7-44e9-992b-cfe221b6619c/volumes"
Jul 10 00:30:01.359991 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:01.359960    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:30:26.259610 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:26.259574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:30:32.437759 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:32.437724    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:30:42.471116 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.471080    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"]
Jul 10 00:30:42.471561 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.471543    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352961e5-09d7-44e9-992b-cfe221b6619c" containerName="authorino"
Jul 10 00:30:42.471628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.471567    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="352961e5-09d7-44e9-992b-cfe221b6619c" containerName="authorino"
Jul 10 00:30:42.471687 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.471674    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="352961e5-09d7-44e9-992b-cfe221b6619c" containerName="authorino"
Jul 10 00:30:42.473771 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.473750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.478122 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.478103    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 00:30:42.478249 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.478130    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 00:30:42.478249 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.478133    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ztfmx\""
Jul 10 00:30:42.478249 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.478130    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 00:30:42.484680 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.484656    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"]
Jul 10 00:30:42.524093 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.524093 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr2wp\" (UniqueName: \"kubernetes.io/projected/c822542c-d62b-4620-ba9a-e02d1ae7bb11-kube-api-access-rr2wp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.524292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.524292 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.524379 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.524379 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.524363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625574 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625574 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr2wp\" (UniqueName: \"kubernetes.io/projected/c822542c-d62b-4620-ba9a-e02d1ae7bb11-kube-api-access-rr2wp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625574 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625574 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625764 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.625894 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.625873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.626024 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.626000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.626131 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.626028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.628995 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.628936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c822542c-d62b-4620-ba9a-e02d1ae7bb11-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.629638 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.629613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c822542c-d62b-4620-ba9a-e02d1ae7bb11-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.633313 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.633288    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr2wp\" (UniqueName: \"kubernetes.io/projected/c822542c-d62b-4620-ba9a-e02d1ae7bb11-kube-api-access-rr2wp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvvps\" (UID: \"c822542c-d62b-4620-ba9a-e02d1ae7bb11\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.784460 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.784373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:42.910203 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.910053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"]
Jul 10 00:30:42.914444 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:30:42.914411    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc822542c_d62b_4620_ba9a_e02d1ae7bb11.slice/crio-208a312bb810d29dcb0ecfb489cebb03fb23986d0aeea677fe790b759dd9f646 WatchSource:0}: Error finding container 208a312bb810d29dcb0ecfb489cebb03fb23986d0aeea677fe790b759dd9f646: Status 404 returned error can't find the container with id 208a312bb810d29dcb0ecfb489cebb03fb23986d0aeea677fe790b759dd9f646
Jul 10 00:30:42.916312 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:42.916295    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 00:30:43.259505 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:43.259458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps" event={"ID":"c822542c-d62b-4620-ba9a-e02d1ae7bb11","Type":"ContainerStarted","Data":"208a312bb810d29dcb0ecfb489cebb03fb23986d0aeea677fe790b759dd9f646"}
Jul 10 00:30:43.837125 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:43.837095    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:30:44.264994 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:44.264953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps" event={"ID":"c822542c-d62b-4620-ba9a-e02d1ae7bb11","Type":"ContainerStarted","Data":"573dc75ac358477c579b4a3ada0e14bcde7cb7165e363e87e543c7df7c1a7c34"}
Jul 10 00:30:44.283334 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:44.283279    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps" podStartSLOduration=1.303461722 podStartE2EDuration="2.283260354s" totalImagesPullingTime="979.798632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:30:44.281940462 +0000 UTC m=+768.767231755" watchObservedRunningTime="2026-07-10 00:30:44.283260354 +0000 UTC m=+768.768551644"
Jul 10 00:30:52.785110 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:52.785076    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:52.785497 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:52.785135    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:52.797617 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:52.797588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:53.314432 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:53.314399    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvvps"
Jul 10 00:30:55.623918 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:30:55.623884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:31:15.928641 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:15.928606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:31:29.468632 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.468596    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"]
Jul 10 00:31:29.471002 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.470980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.473706 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.473681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 00:31:29.482277 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.482243    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"]
Jul 10 00:31:29.544567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.544567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.544765 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.544765 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.544765 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhcn\" (UniqueName: \"kubernetes.io/projected/8936b134-ff05-46da-896d-4340de27fdd1-kube-api-access-5rhcn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.544892 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.544764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8936b134-ff05-46da-896d-4340de27fdd1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8936b134-ff05-46da-896d-4340de27fdd1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhcn\" (UniqueName: \"kubernetes.io/projected/8936b134-ff05-46da-896d-4340de27fdd1-kube-api-access-5rhcn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.645939 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.646040 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.645949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.646122 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.646031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.647737 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.647706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8936b134-ff05-46da-896d-4340de27fdd1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.648128 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.648108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8936b134-ff05-46da-896d-4340de27fdd1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.654079 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.654061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhcn\" (UniqueName: \"kubernetes.io/projected/8936b134-ff05-46da-896d-4340de27fdd1-kube-api-access-5rhcn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk\" (UID: \"8936b134-ff05-46da-896d-4340de27fdd1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.780874 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.780770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:29.907192 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:29.907165    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"]
Jul 10 00:31:29.909726 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:31:29.909696    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8936b134_ff05_46da_896d_4340de27fdd1.slice/crio-17b199de759c70feda490c3c995f25bdf2fbcb31ec2c8c62d5df7388e9581f9d WatchSource:0}: Error finding container 17b199de759c70feda490c3c995f25bdf2fbcb31ec2c8c62d5df7388e9581f9d: Status 404 returned error can't find the container with id 17b199de759c70feda490c3c995f25bdf2fbcb31ec2c8c62d5df7388e9581f9d
Jul 10 00:31:30.475203 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:30.475172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk" event={"ID":"8936b134-ff05-46da-896d-4340de27fdd1","Type":"ContainerStarted","Data":"239ab7a75f1990249a5eacb5b0f7a9801594d1f81e5f2a3fedc5b052832f4fb8"}
Jul 10 00:31:30.475569 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:30.475213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk" event={"ID":"8936b134-ff05-46da-896d-4340de27fdd1","Type":"ContainerStarted","Data":"17b199de759c70feda490c3c995f25bdf2fbcb31ec2c8c62d5df7388e9581f9d"}
Jul 10 00:31:30.493903 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:30.493854    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk" podStartSLOduration=1.3404727730000001 podStartE2EDuration="1.493815907s" totalImagesPullingTime="153.343134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:31:30.492682892 +0000 UTC m=+814.977974183" watchObservedRunningTime="2026-07-10 00:31:30.493815907 +0000 UTC m=+814.979107197"
Jul 10 00:31:31.931107 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:31.931072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:31:39.781130 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:39.781080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:39.781130 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:39.781150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:39.793545 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:39.793517    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:31:40.531342 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:31:40.531315    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk"
Jul 10 00:32:48.361125 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.361055    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cf9df8c4c-8csfv"]
Jul 10 00:32:48.364748 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.364728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.371631 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.371604    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cf9df8c4c-8csfv"]
Jul 10 00:32:48.443137 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.443110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znwr9\" (UniqueName: \"kubernetes.io/projected/0bcef067-b907-4045-b329-c98be2e9e37f-kube-api-access-znwr9\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.443237 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.443170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bcef067-b907-4045-b329-c98be2e9e37f-tls-cert\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.543642 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.543611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bcef067-b907-4045-b329-c98be2e9e37f-tls-cert\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.543766 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.543677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znwr9\" (UniqueName: \"kubernetes.io/projected/0bcef067-b907-4045-b329-c98be2e9e37f-kube-api-access-znwr9\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.545920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.545904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0bcef067-b907-4045-b329-c98be2e9e37f-tls-cert\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.551517 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.551496    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znwr9\" (UniqueName: \"kubernetes.io/projected/0bcef067-b907-4045-b329-c98be2e9e37f-kube-api-access-znwr9\") pod \"authorino-7cf9df8c4c-8csfv\" (UID: \"0bcef067-b907-4045-b329-c98be2e9e37f\") " pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.695696 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.695670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf9df8c4c-8csfv"
Jul 10 00:32:48.826452 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:48.826417    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cf9df8c4c-8csfv"]
Jul 10 00:32:48.829803 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:32:48.829779    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bcef067_b907_4045_b329_c98be2e9e37f.slice/crio-cc23d9564c8fee8178b5673d0d06c8411ed84bb8edbdab29ecdacb8d0e531991 WatchSource:0}: Error finding container cc23d9564c8fee8178b5673d0d06c8411ed84bb8edbdab29ecdacb8d0e531991: Status 404 returned error can't find the container with id cc23d9564c8fee8178b5673d0d06c8411ed84bb8edbdab29ecdacb8d0e531991
Jul 10 00:32:49.833168 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:49.833126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cf9df8c4c-8csfv" event={"ID":"0bcef067-b907-4045-b329-c98be2e9e37f","Type":"ContainerStarted","Data":"5e802af7d68440fdf1bf9d0abe698a57c882d365761249425419406d92296c81"}
Jul 10 00:32:49.833535 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:49.833184    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cf9df8c4c-8csfv" event={"ID":"0bcef067-b907-4045-b329-c98be2e9e37f","Type":"ContainerStarted","Data":"cc23d9564c8fee8178b5673d0d06c8411ed84bb8edbdab29ecdacb8d0e531991"}
Jul 10 00:32:49.850425 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:49.850371    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cf9df8c4c-8csfv" podStartSLOduration=1.311160426 podStartE2EDuration="1.850356589s" totalImagesPullingTime="539.196163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:32:49.848932867 +0000 UTC m=+894.334224161" watchObservedRunningTime="2026-07-10 00:32:49.850356589 +0000 UTC m=+894.335647879"
Jul 10 00:32:49.885548 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:49.885503    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:32:49.885880 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:49.885805    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-746fbff54b-2t6fv" podUID="30d46611-123d-4511-8389-3d88699cc211" containerName="authorino" containerID="cri-o://19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939" gracePeriod=30
Jul 10 00:32:50.158460 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.158434    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:32:50.259523 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.259496    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk8hb\" (UniqueName: \"kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb\") pod \"30d46611-123d-4511-8389-3d88699cc211\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") "
Jul 10 00:32:50.259714 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.259545    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert\") pod \"30d46611-123d-4511-8389-3d88699cc211\" (UID: \"30d46611-123d-4511-8389-3d88699cc211\") "
Jul 10 00:32:50.261690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.261657    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb" (OuterVolumeSpecName: "kube-api-access-mk8hb") pod "30d46611-123d-4511-8389-3d88699cc211" (UID: "30d46611-123d-4511-8389-3d88699cc211"). InnerVolumeSpecName "kube-api-access-mk8hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:32:50.269413 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.269378    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "30d46611-123d-4511-8389-3d88699cc211" (UID: "30d46611-123d-4511-8389-3d88699cc211"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:32:50.360695 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.360653    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk8hb\" (UniqueName: \"kubernetes.io/projected/30d46611-123d-4511-8389-3d88699cc211-kube-api-access-mk8hb\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:32:50.360695 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.360688    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30d46611-123d-4511-8389-3d88699cc211-tls-cert\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:32:50.839912 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.839875    2575 generic.go:356] "Generic (PLEG): container finished" podID="30d46611-123d-4511-8389-3d88699cc211" containerID="19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939" exitCode=0
Jul 10 00:32:50.839912 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.839913    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-746fbff54b-2t6fv"
Jul 10 00:32:50.840416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.839962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-746fbff54b-2t6fv" event={"ID":"30d46611-123d-4511-8389-3d88699cc211","Type":"ContainerDied","Data":"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"}
Jul 10 00:32:50.840416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.840012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-746fbff54b-2t6fv" event={"ID":"30d46611-123d-4511-8389-3d88699cc211","Type":"ContainerDied","Data":"42e19d2490c79f61af67af10bb39806096ccb5d0cbc4a6f7411db2a25858836b"}
Jul 10 00:32:50.840416 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.840035    2575 scope.go:117] "RemoveContainer" containerID="19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"
Jul 10 00:32:50.850253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.850236    2575 scope.go:117] "RemoveContainer" containerID="19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"
Jul 10 00:32:50.850524 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:32:50.850507    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939\": container with ID starting with 19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939 not found: ID does not exist" containerID="19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"
Jul 10 00:32:50.850592 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.850532    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939"} err="failed to get container status \"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939\": rpc error: code = NotFound desc = could not find container \"19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939\": container with ID starting with 19915a71d07542083345b7f78fe00a9c4c72fd4074054ba37320c65883162939 not found: ID does not exist"
Jul 10 00:32:50.860526 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.860500    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:32:50.862659 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:50.862641    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-746fbff54b-2t6fv"]
Jul 10 00:32:52.191045 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:52.191007    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d46611-123d-4511-8389-3d88699cc211" path="/var/lib/kubelet/pods/30d46611-123d-4511-8389-3d88699cc211/volumes"
Jul 10 00:32:56.076924 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:56.076897    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:32:56.078103 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:56.078084    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:32:56.085498 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:56.085476    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:32:56.086749 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:32:56.086732    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:33:21.138628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:33:21.138586    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:33:31.632104 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:33:31.632072    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:33:42.525587 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:33:42.525550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:33:51.739603 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:33:51.739565    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:34:02.536732 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:34:02.536695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:34:31.028281 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:34:31.028244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:34:42.430320 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:34:42.430283    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:35:21.140275 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:35:21.140243    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:35:30.436188 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:35:30.436148    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:35:39.330519 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:35:39.330479    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:35:51.127942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:35:51.127858    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:36:02.142484 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:36:02.142448    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:36:11.132191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:36:11.132152    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:36:23.534891 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:36:23.534856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:36:33.537161 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:36:33.537124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:36:56.438925 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:36:56.438888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:37:05.734253 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:05.734214    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:37:29.440441 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:29.440403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:37:40.437581 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:40.437548    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:37:54.535990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:54.535955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:37:56.105358 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:56.105326    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:37:56.108690 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:56.108666    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:37:56.114629 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:56.114603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:37:56.117959 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:37:56.117938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:38:04.133872 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:38:04.133819    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:38:15.729484 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:38:15.729435    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:38:25.631567 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:38:25.631526    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:38:35.133582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:38:35.133544    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:40:22.130645 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:40:22.130613    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:40:34.034507 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:40:34.034468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:40:42.836429 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:40:42.836384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:40:52.228852 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:40:52.228808    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:01.529521 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:01.529488    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:10.444444 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:10.444413    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:21.525057 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:21.525026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:33.232863 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:33.232816    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:42.430791 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:42.430745    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:41:53.136381 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:41:53.136298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:05.352706 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:05.352669    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:13.950417 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:13.950377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:32.830786 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:32.830753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:46.730011 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:46.729980    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:54.038988 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:54.038952    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:42:56.135379 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:56.135353    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:42:56.140131 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:56.140108    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:42:56.151717 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:56.151691    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:42:56.156364 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:42:56.156343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:43:04.432308 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:04.432277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:43:13.737348 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:13.737312    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:43:23.034207 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:23.034105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:43:34.131744 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:34.131703    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:43:45.428299 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:45.428263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:43:55.028659 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:43:55.028627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:44:05.236059 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:44:05.236022    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:44:14.829769 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:44:14.829736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:44:32.531900 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:44:32.531867    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:44:42.039869 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:44:42.039825    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:44:52.131926 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:44:52.131829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:02.035103 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:02.035060    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:13.638701 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:13.638660    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:22.632094 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:22.632061    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:31.433582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:31.433538    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:43.330509 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:43.330462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:45:53.632471 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:45:53.632434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:46:05.335586 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:46:05.335550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:46:18.032208 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:46:18.032129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:46:30.835820 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:46:30.835774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:46:41.129538 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:46:41.129501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:46:54.329641 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:46:54.329606    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:47:07.234345 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:47:07.234311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:47:56.170178 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:47:56.170147    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:47:56.175463 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:47:56.175436    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:47:56.177869 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:47:56.177849    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:47:56.182965 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:47:56.182945    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:48:42.929030 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:48:42.928991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:48:51.534754 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:48:51.534719    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:49:03.632536 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:49:03.632499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:49:14.945761 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:49:14.945725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:49:46.927882 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:49:46.927845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:50:06.371014 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.370929    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:50:06.371400 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.371381    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d46611-123d-4511-8389-3d88699cc211" containerName="authorino"
Jul 10 00:50:06.371400 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.371394    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d46611-123d-4511-8389-3d88699cc211" containerName="authorino"
Jul 10 00:50:06.371472 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.371464    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="30d46611-123d-4511-8389-3d88699cc211" containerName="authorino"
Jul 10 00:50:06.374495 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.374479    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.378549 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.378529    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-de57c55c\"/\"kube-root-ca.crt\""
Jul 10 00:50:06.378670 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.378530    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-de57c55c\"/\"e2e-lifecycle-model-de57c55c-kserve-self-signed-certs\""
Jul 10 00:50:06.378861 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.378816    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-de57c55c\"/\"default-dockercfg-wknjq\""
Jul 10 00:50:06.378954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.378872    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-de57c55c\"/\"openshift-service-ca.crt\""
Jul 10 00:50:06.382311 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.382292    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:50:06.472255 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.472399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.472399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.472399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.472514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.472514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.472476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9jr\" (UniqueName: \"kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573582 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9jr\" (UniqueName: \"kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.573810 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.574049 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.573942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.574106 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.574054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.574106 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.574096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.575932 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.575910    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.576114 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.576097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.581971 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.581948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9jr\" (UniqueName: \"kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr\") pod \"e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") " pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.685139 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.685101    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:06.816504 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:06.816473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:50:06.817922 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:50:06.817889    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod989d3abf_8c67_49ff_97c3_4610baef976e.slice/crio-f2eb9cabc4ab2c9b49e3a08390ff8b6e2bf2b274e3a1175b688bbdcd0306f6fa WatchSource:0}: Error finding container f2eb9cabc4ab2c9b49e3a08390ff8b6e2bf2b274e3a1175b688bbdcd0306f6fa: Status 404 returned error can't find the container with id f2eb9cabc4ab2c9b49e3a08390ff8b6e2bf2b274e3a1175b688bbdcd0306f6fa
Jul 10 00:50:07.500913 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:07.500871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" event={"ID":"989d3abf-8c67-49ff-97c3-4610baef976e","Type":"ContainerStarted","Data":"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"}
Jul 10 00:50:07.500913 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:07.500923    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" event={"ID":"989d3abf-8c67-49ff-97c3-4610baef976e","Type":"ContainerStarted","Data":"f2eb9cabc4ab2c9b49e3a08390ff8b6e2bf2b274e3a1175b688bbdcd0306f6fa"}
Jul 10 00:50:07.518436 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:07.518392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" podStartSLOduration=1.518375935 podStartE2EDuration="1.518375935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:50:07.516569386 +0000 UTC m=+1932.001860680" watchObservedRunningTime="2026-07-10 00:50:07.518375935 +0000 UTC m=+1932.003667226"
Jul 10 00:50:09.532359 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:09.532326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:50:16.685741 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:16.685710    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:16.686246 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:16.685991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:16.698412 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:16.698387    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:17.557363 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:17.557333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:30.232961 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:30.232924    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:50:43.817121 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:43.817084    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:50:45.127570 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:45.127535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:50:58.837730 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:58.837638    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" podUID="989d3abf-8c67-49ff-97c3-4610baef976e" containerName="main" containerID="cri-o://35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1" gracePeriod=45
Jul 10 00:50:59.091132 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.091072    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:59.153552 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153520    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.153721 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153566    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.153721 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh9jr\" (UniqueName: \"kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.153866 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153767    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.153866 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153853    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:50:59.153990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153872    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache" (OuterVolumeSpecName: "model-cache") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:50:59.153990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153882    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.153990 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.153911    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home\") pod \"989d3abf-8c67-49ff-97c3-4610baef976e\" (UID: \"989d3abf-8c67-49ff-97c3-4610baef976e\") "
Jul 10 00:50:59.154280 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.154249    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home" (OuterVolumeSpecName: "home") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:50:59.154405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.154298    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.154405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.154321    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.155953 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.155929    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm" (OuterVolumeSpecName: "dshm") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:50:59.156067 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.155969    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr" (OuterVolumeSpecName: "kube-api-access-dh9jr") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "kube-api-access-dh9jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:50:59.156131 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.156066    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "989d3abf-8c67-49ff-97c3-4610baef976e" (UID: "989d3abf-8c67-49ff-97c3-4610baef976e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:50:59.255151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.255117    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh9jr\" (UniqueName: \"kubernetes.io/projected/989d3abf-8c67-49ff-97c3-4610baef976e-kube-api-access-dh9jr\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.255151 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.255148    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d3abf-8c67-49ff-97c3-4610baef976e-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.255333 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.255162    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.255333 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.255174    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989d3abf-8c67-49ff-97c3-4610baef976e-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:50:59.731969 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.731932    2575 generic.go:356] "Generic (PLEG): container finished" podID="989d3abf-8c67-49ff-97c3-4610baef976e" containerID="35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1" exitCode=0
Jul 10 00:50:59.732145 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.731981    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"
Jul 10 00:50:59.732145 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.731978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" event={"ID":"989d3abf-8c67-49ff-97c3-4610baef976e","Type":"ContainerDied","Data":"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"}
Jul 10 00:50:59.732145 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.732081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64" event={"ID":"989d3abf-8c67-49ff-97c3-4610baef976e","Type":"ContainerDied","Data":"f2eb9cabc4ab2c9b49e3a08390ff8b6e2bf2b274e3a1175b688bbdcd0306f6fa"}
Jul 10 00:50:59.732145 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.732102    2575 scope.go:117] "RemoveContainer" containerID="35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"
Jul 10 00:50:59.741612 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.741594    2575 scope.go:117] "RemoveContainer" containerID="35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"
Jul 10 00:50:59.741905 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:50:59.741883    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1\": container with ID starting with 35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1 not found: ID does not exist" containerID="35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"
Jul 10 00:50:59.741961 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.741918    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1"} err="failed to get container status \"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1\": rpc error: code = NotFound desc = could not find container \"35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1\": container with ID starting with 35a2d3759642371e42b7dad0846884143595b9b37e49869d7bd452e55d5bfea1 not found: ID does not exist"
Jul 10 00:50:59.753759 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.753734    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:50:59.756721 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:50:59.756701    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-de57c55c/e2e-lifecycle-model-de57c55c-kserve-756587d687-n5t64"]
Jul 10 00:51:00.190991 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:51:00.190960    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989d3abf-8c67-49ff-97c3-4610baef976e" path="/var/lib/kubelet/pods/989d3abf-8c67-49ff-97c3-4610baef976e/volumes"
Jul 10 00:51:22.932181 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:51:22.932143    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:51:33.832775 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:51:33.832740    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:51:43.436044 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:51:43.436014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:52:31.532873 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:31.532820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:52:42.826028 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:42.825993    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:52:49.494309 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.494240    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:52:49.494777 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.494576    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989d3abf-8c67-49ff-97c3-4610baef976e" containerName="main"
Jul 10 00:52:49.494777 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.494587    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="989d3abf-8c67-49ff-97c3-4610baef976e" containerName="main"
Jul 10 00:52:49.494777 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.494648    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="989d3abf-8c67-49ff-97c3-4610baef976e" containerName="main"
Jul 10 00:52:49.497781 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.497758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.500511 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.500491    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3ea0d8\"/\"openshift-service-ca.crt\""
Jul 10 00:52:49.501591 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.501552    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3ea0d8\"/\"test-model-3ea0d8-kserve-self-signed-certs\""
Jul 10 00:52:49.501693 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.501595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3ea0d8\"/\"kube-root-ca.crt\""
Jul 10 00:52:49.501693 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.501628    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3ea0d8\"/\"default-dockercfg-mqh77\""
Jul 10 00:52:49.506225 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.506205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:52:49.609780 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.609780 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfd6\" (UniqueName: \"kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.610003 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.610003 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.610003 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.610101 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.609998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710623 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710790 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710790 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710933 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710933 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.710933 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.710915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfd6\" (UniqueName: \"kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.711083 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.711000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.711193 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.711173    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.711193 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.711186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.712919 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.712901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.713358 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.713338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.718691 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.718670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdfd6\" (UniqueName: \"kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6\") pod \"test-model-3ea0d8-kserve-5977bbc5ff-rxb4s\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") " pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.809031 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.808948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:49.934851 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:49.934809    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:52:49.937501 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:52:49.937471    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c9da3e3_a5f5_44e3_a37a_30a232e511c5.slice/crio-22a0e55d08c30a4cd1514c52fa90296c94b50f2f57a9d52ae6739f4e922516d5 WatchSource:0}: Error finding container 22a0e55d08c30a4cd1514c52fa90296c94b50f2f57a9d52ae6739f4e922516d5: Status 404 returned error can't find the container with id 22a0e55d08c30a4cd1514c52fa90296c94b50f2f57a9d52ae6739f4e922516d5
Jul 10 00:52:50.231440 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:50.231403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" event={"ID":"2c9da3e3-a5f5-44e3-a37a-30a232e511c5","Type":"ContainerStarted","Data":"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"}
Jul 10 00:52:50.231440 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:50.231447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" event={"ID":"2c9da3e3-a5f5-44e3-a37a-30a232e511c5","Type":"ContainerStarted","Data":"22a0e55d08c30a4cd1514c52fa90296c94b50f2f57a9d52ae6739f4e922516d5"}
Jul 10 00:52:50.248641 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:50.248593    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" podStartSLOduration=1.248577628 podStartE2EDuration="1.248577628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:52:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:52:50.246352277 +0000 UTC m=+2094.731643567" watchObservedRunningTime="2026-07-10 00:52:50.248577628 +0000 UTC m=+2094.733868919"
Jul 10 00:52:53.640352 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:53.640316    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:52:56.198551 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:56.197824    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:52:56.209405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:56.209377    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:52:56.211564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:56.211542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:52:56.216938 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:56.216919    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:52:59.809188 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:59.809150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:59.809564 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:59.809216    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:52:59.821550 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:52:59.821521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:53:00.286382 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:53:00.286356    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:53:05.026685 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:53:05.026642    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:53:33.829546 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:53:33.829510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:53:50.757870 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:53:50.757762    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:53:51.233636 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:53:51.233602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:54:04.236662 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:04.236632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:54:05.778598 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:05.778534    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" podUID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" containerName="main" containerID="cri-o://407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c" gracePeriod=45
Jul 10 00:54:06.022399 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.022374    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:54:06.085320 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085294    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdfd6\" (UniqueName: \"kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085458 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085360    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085458 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085386    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085458 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085407    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085458 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085662 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085467    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache\") pod \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\" (UID: \"2c9da3e3-a5f5-44e3-a37a-30a232e511c5\") "
Jul 10 00:54:06.085662 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085631    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:54:06.085762 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home" (OuterVolumeSpecName: "home") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:54:06.085762 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085716    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.085867 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.085819    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:54:06.087544 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.087514    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6" (OuterVolumeSpecName: "kube-api-access-gdfd6") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "kube-api-access-gdfd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:54:06.087658 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.087553    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm" (OuterVolumeSpecName: "dshm") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:54:06.087658 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.087578    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c9da3e3-a5f5-44e3-a37a-30a232e511c5" (UID: "2c9da3e3-a5f5-44e3-a37a-30a232e511c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:54:06.186529 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.186498    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.186529 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.186525    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.186732 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.186538    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.186732 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.186552    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.186732 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.186565    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdfd6\" (UniqueName: \"kubernetes.io/projected/2c9da3e3-a5f5-44e3-a37a-30a232e511c5-kube-api-access-gdfd6\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:54:06.578025 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.577995    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" containerID="407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c" exitCode=0
Jul 10 00:54:06.578191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.578036    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"
Jul 10 00:54:06.578191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.578057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" event={"ID":"2c9da3e3-a5f5-44e3-a37a-30a232e511c5","Type":"ContainerDied","Data":"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"}
Jul 10 00:54:06.578191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.578090    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s" event={"ID":"2c9da3e3-a5f5-44e3-a37a-30a232e511c5","Type":"ContainerDied","Data":"22a0e55d08c30a4cd1514c52fa90296c94b50f2f57a9d52ae6739f4e922516d5"}
Jul 10 00:54:06.578191 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.578108    2575 scope.go:117] "RemoveContainer" containerID="407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"
Jul 10 00:54:06.586713 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.586694    2575 scope.go:117] "RemoveContainer" containerID="407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"
Jul 10 00:54:06.586966 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:54:06.586945    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c\": container with ID starting with 407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c not found: ID does not exist" containerID="407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"
Jul 10 00:54:06.587052 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.586975    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c"} err="failed to get container status \"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c\": rpc error: code = NotFound desc = could not find container \"407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c\": container with ID starting with 407620b61499c944239e2e718cd9a5a85545d1c3fba4223221facdf68f8ec14c not found: ID does not exist"
Jul 10 00:54:06.595230 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.595202    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:54:06.599239 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:06.599218    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3ea0d8/test-model-3ea0d8-kserve-5977bbc5ff-rxb4s"]
Jul 10 00:54:08.190487 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:08.190446    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" path="/var/lib/kubelet/pods/2c9da3e3-a5f5-44e3-a37a-30a232e511c5/volumes"
Jul 10 00:54:39.037297 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:39.037263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:54:53.537410 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:54:53.537370    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:55:05.829243 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:05.829211    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:55:18.838375 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:18.838293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:55:31.539562 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:31.539531    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:55:42.926877 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:42.926821    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:55:56.573677 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.573643    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:55:56.574150 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.574074    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" containerName="main"
Jul 10 00:55:56.574150 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.574090    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" containerName="main"
Jul 10 00:55:56.574245 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.574194    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9da3e3-a5f5-44e3-a37a-30a232e511c5" containerName="main"
Jul 10 00:55:56.577492 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.577466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.581633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.581383    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"kube-root-ca.crt\""
Jul 10 00:55:56.581633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.581424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"auth-test-model-df95cf-kserve-self-signed-certs\""
Jul 10 00:55:56.581633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.581483    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"default-dockercfg-l2xkc\""
Jul 10 00:55:56.581633 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.581428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"openshift-service-ca.crt\""
Jul 10 00:55:56.587700 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.587676    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:55:56.732558 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.732558 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.732816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.732816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpmgq\" (UniqueName: \"kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.732816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.732816 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.732810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834472 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpmgq\" (UniqueName: \"kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834472 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834472 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834628 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.834698 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.834644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.836461 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.836438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.836632 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.836547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.841706 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.841684    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpmgq\" (UniqueName: \"kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq\") pod \"auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") " pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:56.889945 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:56.889906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:55:57.016081 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:57.016055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:55:57.018090 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:55:57.018064    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb6012b9_1417_495a_ab94_fb5726f8b43e.slice/crio-625e1b3f682e0b5f4eb8c327d0e64f7741f42d5600e085298e769dbd14d0e51d WatchSource:0}: Error finding container 625e1b3f682e0b5f4eb8c327d0e64f7741f42d5600e085298e769dbd14d0e51d: Status 404 returned error can't find the container with id 625e1b3f682e0b5f4eb8c327d0e64f7741f42d5600e085298e769dbd14d0e51d
Jul 10 00:55:57.068516 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:57.068485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" event={"ID":"fb6012b9-1417-495a-ab94-fb5726f8b43e","Type":"ContainerStarted","Data":"625e1b3f682e0b5f4eb8c327d0e64f7741f42d5600e085298e769dbd14d0e51d"}
Jul 10 00:55:58.074032 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:58.073997    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" event={"ID":"fb6012b9-1417-495a-ab94-fb5726f8b43e","Type":"ContainerStarted","Data":"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"}
Jul 10 00:55:58.090686 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:58.090639    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" podStartSLOduration=2.0906246 podStartE2EDuration="2.0906246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:55:58.089686854 +0000 UTC m=+2282.574978146" watchObservedRunningTime="2026-07-10 00:55:58.0906246 +0000 UTC m=+2282.575915890"
Jul 10 00:55:59.733848 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:55:59.733804    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:56:06.890509 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:06.890471    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:56:06.891071 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:06.890529    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:56:06.903134 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:06.903109    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:56:07.123571 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:07.123539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:56:26.137877 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:26.137829    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:56:42.940631 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:56:42.940592    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:57:00.632120 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:00.632038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:57:15.328299 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:15.328256    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:57:33.429484 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:33.429451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:57:49.331266 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:49.331232    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:57:56.231576 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:56.231550    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:57:56.237320 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:56.237299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 00:57:56.239653 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:56.239635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:57:56.244716 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:57:56.244699    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 00:58:05.833296 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:05.833263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:58:19.051769 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:19.051694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:58:23.633562 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:23.633525    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:58:31.361565 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.361526    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 00:58:31.364973 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.364950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.367364 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.367341    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"sub-test-model-df95cf-kserve-self-signed-certs\""
Jul 10 00:58:31.374087 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.374067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 00:58:31.418164 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.418285 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhbk\" (UniqueName: \"kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.418285 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.418368 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.418368 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.418368 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.418349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519123 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519242 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519135    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519286 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519328 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhbk\" (UniqueName: \"kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519369 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519410 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519651 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519626    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.519722 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.519703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.521453 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.521435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.521828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.521807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.527435 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.527410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhbk\" (UniqueName: \"kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk\") pod \"sub-test-model-df95cf-kserve-65bd66bbb5-r4czz\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") " pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.674040 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.674012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:31.804155 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:31.804071    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 00:58:31.806851 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:58:31.806803    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd055a47_807b_4409_a2de_1f6fe00db8c5.slice/crio-3cfe50bfb413b0eb811839e779e364ddc8d8bef2b3ddae954c04127048fb916f WatchSource:0}: Error finding container 3cfe50bfb413b0eb811839e779e364ddc8d8bef2b3ddae954c04127048fb916f: Status 404 returned error can't find the container with id 3cfe50bfb413b0eb811839e779e364ddc8d8bef2b3ddae954c04127048fb916f
Jul 10 00:58:32.765346 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:32.765316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" event={"ID":"cd055a47-807b-4409-a2de-1f6fe00db8c5","Type":"ContainerStarted","Data":"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"}
Jul 10 00:58:32.765697 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:32.765357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" event={"ID":"cd055a47-807b-4409-a2de-1f6fe00db8c5","Type":"ContainerStarted","Data":"3cfe50bfb413b0eb811839e779e364ddc8d8bef2b3ddae954c04127048fb916f"}
Jul 10 00:58:32.782080 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:32.782026    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" podStartSLOduration=1.782011349 podStartE2EDuration="1.782011349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:58:32.780467528 +0000 UTC m=+2437.265758819" watchObservedRunningTime="2026-07-10 00:58:32.782011349 +0000 UTC m=+2437.267302640"
Jul 10 00:58:34.071439 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.071396    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" podUID="fb6012b9-1417-495a-ab94-fb5726f8b43e" containerName="main" containerID="cri-o://a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c" gracePeriod=45
Jul 10 00:58:34.320957 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.320930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:58:34.446571 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446537    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446600    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446641    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446666    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpmgq\" (UniqueName: \"kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446731 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446692    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446966 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446749    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm\") pod \"fb6012b9-1417-495a-ab94-fb5726f8b43e\" (UID: \"fb6012b9-1417-495a-ab94-fb5726f8b43e\") "
Jul 10 00:58:34.446966 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446779    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:58:34.446966 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home" (OuterVolumeSpecName: "home") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:58:34.446966 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.446903    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:58:34.447136 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.447031    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.447136 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.447045    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.447136 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.447055    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.448867 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.448844    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm" (OuterVolumeSpecName: "dshm") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 00:58:34.448949 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.448913    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 00:58:34.449006 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.448987    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq" (OuterVolumeSpecName: "kube-api-access-rpmgq") pod "fb6012b9-1417-495a-ab94-fb5726f8b43e" (UID: "fb6012b9-1417-495a-ab94-fb5726f8b43e"). InnerVolumeSpecName "kube-api-access-rpmgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 00:58:34.547828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.547796    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpmgq\" (UniqueName: \"kubernetes.io/projected/fb6012b9-1417-495a-ab94-fb5726f8b43e-kube-api-access-rpmgq\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.547828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.547824    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb6012b9-1417-495a-ab94-fb5726f8b43e-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.547828 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.547854    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb6012b9-1417-495a-ab94-fb5726f8b43e-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 00:58:34.776668 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.776586    2575 generic.go:356] "Generic (PLEG): container finished" podID="fb6012b9-1417-495a-ab94-fb5726f8b43e" containerID="a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c" exitCode=0
Jul 10 00:58:34.776668 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.776630    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"
Jul 10 00:58:34.776920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.776668    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" event={"ID":"fb6012b9-1417-495a-ab94-fb5726f8b43e","Type":"ContainerDied","Data":"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"}
Jul 10 00:58:34.776920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.776716    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8" event={"ID":"fb6012b9-1417-495a-ab94-fb5726f8b43e","Type":"ContainerDied","Data":"625e1b3f682e0b5f4eb8c327d0e64f7741f42d5600e085298e769dbd14d0e51d"}
Jul 10 00:58:34.776920 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.776739    2575 scope.go:117] "RemoveContainer" containerID="a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"
Jul 10 00:58:34.790443 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.790419    2575 scope.go:117] "RemoveContainer" containerID="a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"
Jul 10 00:58:34.790929 ip-10-0-141-199 kubenswrapper[2575]: E0710 00:58:34.790907    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c\": container with ID starting with a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c not found: ID does not exist" containerID="a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"
Jul 10 00:58:34.791025 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.790940    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c"} err="failed to get container status \"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c\": rpc error: code = NotFound desc = could not find container \"a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c\": container with ID starting with a917431627d5f14ef473fdfba8417185375409de0a45b370b162673495e13f2c not found: ID does not exist"
Jul 10 00:58:34.802257 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.802233    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:58:34.809856 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:34.809816    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/auth-test-model-df95cf-kserve-647dfcf8f5-w7gp8"]
Jul 10 00:58:36.191405 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:36.191369    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6012b9-1417-495a-ab94-fb5726f8b43e" path="/var/lib/kubelet/pods/fb6012b9-1417-495a-ab94-fb5726f8b43e/volumes"
Jul 10 00:58:41.674992 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:41.674959    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:41.675386 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:41.675009    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:41.687234 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:41.687210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:41.820472 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:41.820442    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 00:58:44.027354 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:58:44.027321    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:59:08.658725 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.658693    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 00:59:08.659194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.659062    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6012b9-1417-495a-ab94-fb5726f8b43e" containerName="main"
Jul 10 00:59:08.659194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.659074    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6012b9-1417-495a-ab94-fb5726f8b43e" containerName="main"
Jul 10 00:59:08.659194 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.659138    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb6012b9-1417-495a-ab94-fb5726f8b43e" containerName="main"
Jul 10 00:59:08.662101 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.662083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.664632 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.664611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82df1b\"/\"kube-root-ca.crt\""
Jul 10 00:59:08.666059 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.666037    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82df1b\"/\"default-dockercfg-f42sc\""
Jul 10 00:59:08.666059 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.666049    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82df1b\"/\"openshift-service-ca.crt\""
Jul 10 00:59:08.666229 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.666090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82df1b\"/\"sub-test-model-82df1b-kserve-self-signed-certs\""
Jul 10 00:59:08.672954 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.672930    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 00:59:08.749986 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.749961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.750084 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.749992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.750084 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.750014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.750169 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.750100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.750169 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.750135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bndx2\" (UniqueName: \"kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.750254 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.750195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850598 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850687 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850687 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850687 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.850803 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.850719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bndx2\" (UniqueName: \"kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.851034 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.851014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.851083 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.851046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.851083 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.851061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.852942 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.852926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.853017 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.853003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.858133 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.858115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bndx2\" (UniqueName: \"kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2\") pod \"sub-test-model-82df1b-kserve-6f8dbf457-df7f7\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") " pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:08.972823 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:08.972799    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:09.102772 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:09.102750    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 00:59:09.104519 ip-10-0-141-199 kubenswrapper[2575]: W0710 00:59:09.104491    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda28ede7d_4fb1_48bd_989a_f0620b88ec4b.slice/crio-bf44159e1f732f2b33f07af5afcfeee82f088f0d8a5416bc0d837b8f2bda2cc5 WatchSource:0}: Error finding container bf44159e1f732f2b33f07af5afcfeee82f088f0d8a5416bc0d837b8f2bda2cc5: Status 404 returned error can't find the container with id bf44159e1f732f2b33f07af5afcfeee82f088f0d8a5416bc0d837b8f2bda2cc5
Jul 10 00:59:09.934358 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:09.934324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" event={"ID":"a28ede7d-4fb1-48bd-989a-f0620b88ec4b","Type":"ContainerStarted","Data":"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"}
Jul 10 00:59:09.934719 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:09.934366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" event={"ID":"a28ede7d-4fb1-48bd-989a-f0620b88ec4b","Type":"ContainerStarted","Data":"bf44159e1f732f2b33f07af5afcfeee82f088f0d8a5416bc0d837b8f2bda2cc5"}
Jul 10 00:59:09.951344 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:09.951294    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" podStartSLOduration=1.9512814550000002 podStartE2EDuration="1.951281455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:59:09.949278232 +0000 UTC m=+2474.434569524" watchObservedRunningTime="2026-07-10 00:59:09.951281455 +0000 UTC m=+2474.436572746"
Jul 10 00:59:12.831514 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:12.831480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:59:18.973490 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:18.973457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:18.974008 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:18.973506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:18.986064 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:18.986041    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:19.988773 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:19.988742    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 00:59:31.829655 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:31.829618    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:59:51.154622 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:51.154543    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 00:59:57.517618 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:57.517584    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 00:59:58.382590 ip-10-0-141-199 kubenswrapper[2575]: I0710 00:59:58.382553    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 01:00:10.035943 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:10.035909    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:00:12.538071 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.538037    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" podUID="cd055a47-807b-4409-a2de-1f6fe00db8c5" containerName="main" containerID="cri-o://da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa" gracePeriod=45
Jul 10 01:00:12.789583 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.789521    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 01:00:12.935419 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935384    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqhbk\" (UniqueName: \"kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935631 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935459    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935631 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935488    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935631 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935511    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935631 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935631 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache\") pod \"cd055a47-807b-4409-a2de-1f6fe00db8c5\" (UID: \"cd055a47-807b-4409-a2de-1f6fe00db8c5\") "
Jul 10 01:00:12.935927 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935801    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:12.935927 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935870    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home" (OuterVolumeSpecName: "home") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:12.935927 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.935895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:12.937783 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.937760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk" (OuterVolumeSpecName: "kube-api-access-dqhbk") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "kube-api-access-dqhbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:00:12.937783 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.937765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 01:00:12.937783 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:12.937766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm" (OuterVolumeSpecName: "dshm") pod "cd055a47-807b-4409-a2de-1f6fe00db8c5" (UID: "cd055a47-807b-4409-a2de-1f6fe00db8c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:13.037152 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037120    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqhbk\" (UniqueName: \"kubernetes.io/projected/cd055a47-807b-4409-a2de-1f6fe00db8c5-kube-api-access-dqhbk\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.037152 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037147    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.037152 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037158    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.037365 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037166    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd055a47-807b-4409-a2de-1f6fe00db8c5-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.037365 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037173    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.037365 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.037180    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd055a47-807b-4409-a2de-1f6fe00db8c5-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.211112 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.211079    2575 generic.go:356] "Generic (PLEG): container finished" podID="cd055a47-807b-4409-a2de-1f6fe00db8c5" containerID="da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa" exitCode=0
Jul 10 01:00:13.211279 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.211124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"
Jul 10 01:00:13.211279 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.211166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" event={"ID":"cd055a47-807b-4409-a2de-1f6fe00db8c5","Type":"ContainerDied","Data":"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"}
Jul 10 01:00:13.211279 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.211206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz" event={"ID":"cd055a47-807b-4409-a2de-1f6fe00db8c5","Type":"ContainerDied","Data":"3cfe50bfb413b0eb811839e779e364ddc8d8bef2b3ddae954c04127048fb916f"}
Jul 10 01:00:13.211279 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.211226    2575 scope.go:117] "RemoveContainer" containerID="da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"
Jul 10 01:00:13.220304 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.220289    2575 scope.go:117] "RemoveContainer" containerID="da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"
Jul 10 01:00:13.220553 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:00:13.220530    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa\": container with ID starting with da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa not found: ID does not exist" containerID="da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"
Jul 10 01:00:13.220620 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.220561    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa"} err="failed to get container status \"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa\": rpc error: code = NotFound desc = could not find container \"da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa\": container with ID starting with da8316615a96d2f181ca8f78264ac9656090ca35adf3b92fcffe39cb511011fa not found: ID does not exist"
Jul 10 01:00:13.232080 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.232057    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 01:00:13.234258 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.234236    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/sub-test-model-df95cf-kserve-65bd66bbb5-r4czz"]
Jul 10 01:00:13.403739 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.403698    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" podUID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" containerName="main" containerID="cri-o://f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159" gracePeriod=45
Jul 10 01:00:13.658001 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.657976    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 01:00:13.743257 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743226    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743446 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743324    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bndx2\" (UniqueName: \"kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743446 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743354    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743446 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743606 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743448    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743606 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743469    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache\") pod \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\" (UID: \"a28ede7d-4fb1-48bd-989a-f0620b88ec4b\") "
Jul 10 01:00:13.743756 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743690    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home" (OuterVolumeSpecName: "home") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:13.743883 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743704    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:13.743883 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.743771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:13.745561 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.745537    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm" (OuterVolumeSpecName: "dshm") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:00:13.745642 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.745576    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2" (OuterVolumeSpecName: "kube-api-access-bndx2") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "kube-api-access-bndx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:00:13.745642 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.745624    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a28ede7d-4fb1-48bd-989a-f0620b88ec4b" (UID: "a28ede7d-4fb1-48bd-989a-f0620b88ec4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844854    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bndx2\" (UniqueName: \"kubernetes.io/projected/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-kube-api-access-bndx2\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844882    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844892    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844900    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844907    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.844934 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.844914    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28ede7d-4fb1-48bd-989a-f0620b88ec4b-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:00:13.872484 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872446    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:00:13.872847 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872817    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd055a47-807b-4409-a2de-1f6fe00db8c5" containerName="main"
Jul 10 01:00:13.872935 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872853    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd055a47-807b-4409-a2de-1f6fe00db8c5" containerName="main"
Jul 10 01:00:13.872935 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872868    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" containerName="main"
Jul 10 01:00:13.872935 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872876    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" containerName="main"
Jul 10 01:00:13.873078 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872980    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd055a47-807b-4409-a2de-1f6fe00db8c5" containerName="main"
Jul 10 01:00:13.873078 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.872996    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" containerName="main"
Jul 10 01:00:13.876071 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.876052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.878896 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.878876    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"default-dockercfg-l2xkc\""
Jul 10 01:00:13.878896 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.878888    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"kube-root-ca.crt\""
Jul 10 01:00:13.879078 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.878907    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"openshift-service-ca.crt\""
Jul 10 01:00:13.879078 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.878971    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-df95cf\"/\"rate-test-model-df95cf-kserve-self-signed-certs\""
Jul 10 01:00:13.886117 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.886097    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:00:13.945712 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.945712 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4fn7\" (UniqueName: \"kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.945955 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.945955 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.945955 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:13.945955 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:13.945937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047049 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047049 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4fn7\" (UniqueName: \"kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047236 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047236 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047236 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047143    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047236 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047487 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047466    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047556 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.047612 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.047579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.049346 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.049327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.049557 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.049539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.055977 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.055956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4fn7\" (UniqueName: \"kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7\") pod \"rate-test-model-df95cf-kserve-69d455f4c-shdpw\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") " pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.186588 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.186561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:14.191552 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.191525    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd055a47-807b-4409-a2de-1f6fe00db8c5" path="/var/lib/kubelet/pods/cd055a47-807b-4409-a2de-1f6fe00db8c5/volumes"
Jul 10 01:00:14.218321 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.218292    2575 generic.go:356] "Generic (PLEG): container finished" podID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" containerID="f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159" exitCode=0
Jul 10 01:00:14.218473 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.218326    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"
Jul 10 01:00:14.218473 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.218333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" event={"ID":"a28ede7d-4fb1-48bd-989a-f0620b88ec4b","Type":"ContainerDied","Data":"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"}
Jul 10 01:00:14.218473 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.218370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7" event={"ID":"a28ede7d-4fb1-48bd-989a-f0620b88ec4b","Type":"ContainerDied","Data":"bf44159e1f732f2b33f07af5afcfeee82f088f0d8a5416bc0d837b8f2bda2cc5"}
Jul 10 01:00:14.218473 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.218389    2575 scope.go:117] "RemoveContainer" containerID="f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"
Jul 10 01:00:14.227469 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.227446    2575 scope.go:117] "RemoveContainer" containerID="f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"
Jul 10 01:00:14.227737 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:00:14.227713    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159\": container with ID starting with f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159 not found: ID does not exist" containerID="f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"
Jul 10 01:00:14.227825 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.227743    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159"} err="failed to get container status \"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159\": rpc error: code = NotFound desc = could not find container \"f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159\": container with ID starting with f23f3e7b3a0a4f7b967f3a0a662a5e35453b2d539b0afd89a2d437af9afa8159 not found: ID does not exist"
Jul 10 01:00:14.240489 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.240460    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 01:00:14.245124 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.245099    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82df1b/sub-test-model-82df1b-kserve-6f8dbf457-df7f7"]
Jul 10 01:00:14.316250 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:14.316229    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:00:14.318330 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:00:14.318289    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f27ce55_b161_4bd1_be5b_42c0d837a2fc.slice/crio-2a26843b46b13fb333449581356d3917dba685c41941a915938738ed76a5f355 WatchSource:0}: Error finding container 2a26843b46b13fb333449581356d3917dba685c41941a915938738ed76a5f355: Status 404 returned error can't find the container with id 2a26843b46b13fb333449581356d3917dba685c41941a915938738ed76a5f355
Jul 10 01:00:15.223435 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:15.223401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" event={"ID":"2f27ce55-b161-4bd1-be5b-42c0d837a2fc","Type":"ContainerStarted","Data":"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"}
Jul 10 01:00:15.223435 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:15.223440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" event={"ID":"2f27ce55-b161-4bd1-be5b-42c0d837a2fc","Type":"ContainerStarted","Data":"2a26843b46b13fb333449581356d3917dba685c41941a915938738ed76a5f355"}
Jul 10 01:00:15.239755 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:15.239713    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" podStartSLOduration=2.239695713 podStartE2EDuration="2.239695713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 01:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:00:15.238330955 +0000 UTC m=+2539.723622259" watchObservedRunningTime="2026-07-10 01:00:15.239695713 +0000 UTC m=+2539.724987003"
Jul 10 01:00:16.191338 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:16.191295    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a28ede7d-4fb1-48bd-989a-f0620b88ec4b" path="/var/lib/kubelet/pods/a28ede7d-4fb1-48bd-989a-f0620b88ec4b/volumes"
Jul 10 01:00:24.191695 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:24.191665    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:24.192303 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:24.191707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:24.200059 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:24.200037    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:24.273363 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:24.273336    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:00:26.737094 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:00:26.737063    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:01:02.431855 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:02.431798    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:01:26.933433 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:26.933350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:01:42.526493 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:42.526456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:01:48.853557 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:48.853518    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:01:50.900283 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:50.900243    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449691474992"]
Jul 10 01:01:50.903863 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:50.903821    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:50.906332 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:50.906314    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-bggfg\""
Jul 10 01:01:50.909580 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:50.909558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474992"]
Jul 10 01:01:50.930656 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:50.930632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dgqs\" (UniqueName: \"kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs\") pod \"test-curl-7080-140449691474992\" (UID: \"db84150e-81a3-4795-ab0f-4b10907311cf\") " pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:51.031530 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.031506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dgqs\" (UniqueName: \"kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs\") pod \"test-curl-7080-140449691474992\" (UID: \"db84150e-81a3-4795-ab0f-4b10907311cf\") " pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:51.040091 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.040068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dgqs\" (UniqueName: \"kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs\") pod \"test-curl-7080-140449691474992\" (UID: \"db84150e-81a3-4795-ab0f-4b10907311cf\") " pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:51.213744 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.213716    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:51.341673 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.341647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474992"]
Jul 10 01:01:51.344394 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:01:51.344370    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb84150e_81a3_4795_ab0f_4b10907311cf.slice/crio-72b5e92723cee1d0dc004d8e7f4ab4929713b5d7e71b3afad3a96f4818846eb6 WatchSource:0}: Error finding container 72b5e92723cee1d0dc004d8e7f4ab4929713b5d7e71b3afad3a96f4818846eb6: Status 404 returned error can't find the container with id 72b5e92723cee1d0dc004d8e7f4ab4929713b5d7e71b3afad3a96f4818846eb6
Jul 10 01:01:51.345662 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.345641    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 01:01:51.658557 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:51.658460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449691474992" event={"ID":"db84150e-81a3-4795-ab0f-4b10907311cf","Type":"ContainerStarted","Data":"72b5e92723cee1d0dc004d8e7f4ab4929713b5d7e71b3afad3a96f4818846eb6"}
Jul 10 01:01:52.664677 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:52.664640    2575 generic.go:356] "Generic (PLEG): container finished" podID="db84150e-81a3-4795-ab0f-4b10907311cf" containerID="af53cd856e6c054a19fd1c89271bae343f2fe06de4366359b2f8aeead59c648e" exitCode=0
Jul 10 01:01:52.664677 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:52.664680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449691474992" event={"ID":"db84150e-81a3-4795-ab0f-4b10907311cf","Type":"ContainerDied","Data":"af53cd856e6c054a19fd1c89271bae343f2fe06de4366359b2f8aeead59c648e"}
Jul 10 01:01:53.805031 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.805005    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:53.839856 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.839814    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449691474992_db84150e-81a3-4795-ab0f-4b10907311cf/test-curl-7080-140449691474992/0.log"
Jul 10 01:01:53.856189 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.856166    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dgqs\" (UniqueName: \"kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs\") pod \"db84150e-81a3-4795-ab0f-4b10907311cf\" (UID: \"db84150e-81a3-4795-ab0f-4b10907311cf\") "
Jul 10 01:01:53.858244 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.858218    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs" (OuterVolumeSpecName: "kube-api-access-9dgqs") pod "db84150e-81a3-4795-ab0f-4b10907311cf" (UID: "db84150e-81a3-4795-ab0f-4b10907311cf"). InnerVolumeSpecName "kube-api-access-9dgqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:01:53.863016 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.862991    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474992"]
Jul 10 01:01:53.866428 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.866402    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474992"]
Jul 10 01:01:53.957068 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.957031    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dgqs\" (UniqueName: \"kubernetes.io/projected/db84150e-81a3-4795-ab0f-4b10907311cf-kube-api-access-9dgqs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:01:53.995912 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.995885    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449691474736"]
Jul 10 01:01:53.996226 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.996214    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db84150e-81a3-4795-ab0f-4b10907311cf" containerName="test-curl-7080-140449691474992"
Jul 10 01:01:53.996312 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.996227    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db84150e-81a3-4795-ab0f-4b10907311cf" containerName="test-curl-7080-140449691474992"
Jul 10 01:01:53.996312 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.996280    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db84150e-81a3-4795-ab0f-4b10907311cf" containerName="test-curl-7080-140449691474992"
Jul 10 01:01:53.999096 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:53.999081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:54.003286 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.003261    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474736"]
Jul 10 01:01:54.057910 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.057871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m29dp\" (UniqueName: \"kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp\") pod \"test-curl-7080-140449691474736\" (UID: \"55e22513-de1f-4a82-baa8-b2c0dc1582a4\") " pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:54.158797 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.158771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m29dp\" (UniqueName: \"kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp\") pod \"test-curl-7080-140449691474736\" (UID: \"55e22513-de1f-4a82-baa8-b2c0dc1582a4\") " pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:54.166894 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.166873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m29dp\" (UniqueName: \"kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp\") pod \"test-curl-7080-140449691474736\" (UID: \"55e22513-de1f-4a82-baa8-b2c0dc1582a4\") " pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:54.191455 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.191430    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db84150e-81a3-4795-ab0f-4b10907311cf" path="/var/lib/kubelet/pods/db84150e-81a3-4795-ab0f-4b10907311cf/volumes"
Jul 10 01:01:54.308983 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.308906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:54.433281 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.433250    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474736"]
Jul 10 01:01:54.436288 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:01:54.436258    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55e22513_de1f_4a82_baa8_b2c0dc1582a4.slice/crio-1fe7106434976180d98fe712e11dca69fac6e64d9d13fb1a6d7c4b8b092139d6 WatchSource:0}: Error finding container 1fe7106434976180d98fe712e11dca69fac6e64d9d13fb1a6d7c4b8b092139d6: Status 404 returned error can't find the container with id 1fe7106434976180d98fe712e11dca69fac6e64d9d13fb1a6d7c4b8b092139d6
Jul 10 01:01:54.674935 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.674909    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474992"
Jul 10 01:01:54.674935 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.674931    2575 scope.go:117] "RemoveContainer" containerID="af53cd856e6c054a19fd1c89271bae343f2fe06de4366359b2f8aeead59c648e"
Jul 10 01:01:54.676356 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:54.676290    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449691474736" event={"ID":"55e22513-de1f-4a82-baa8-b2c0dc1582a4","Type":"ContainerStarted","Data":"1fe7106434976180d98fe712e11dca69fac6e64d9d13fb1a6d7c4b8b092139d6"}
Jul 10 01:01:55.683327 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:55.683283    2575 generic.go:356] "Generic (PLEG): container finished" podID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" containerID="5ac7e5751a363b5df18419ade49a1f42650cfa5d60db2237800ab7536cb3b178" exitCode=0
Jul 10 01:01:55.683715 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:55.683342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449691474736" event={"ID":"55e22513-de1f-4a82-baa8-b2c0dc1582a4","Type":"ContainerDied","Data":"5ac7e5751a363b5df18419ade49a1f42650cfa5d60db2237800ab7536cb3b178"}
Jul 10 01:01:56.330302 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.330276    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:01:56.814129 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.814103    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:56.834495 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.834453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449691474736_55e22513-de1f-4a82-baa8-b2c0dc1582a4/test-curl-7080-140449691474736/0.log"
Jul 10 01:01:56.860382 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.860356    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474736"]
Jul 10 01:01:56.863844 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.863813    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449691474736"]
Jul 10 01:01:56.881552 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.881529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m29dp\" (UniqueName: \"kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp\") pod \"55e22513-de1f-4a82-baa8-b2c0dc1582a4\" (UID: \"55e22513-de1f-4a82-baa8-b2c0dc1582a4\") "
Jul 10 01:01:56.883466 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.883441    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp" (OuterVolumeSpecName: "kube-api-access-m29dp") pod "55e22513-de1f-4a82-baa8-b2c0dc1582a4" (UID: "55e22513-de1f-4a82-baa8-b2c0dc1582a4"). InnerVolumeSpecName "kube-api-access-m29dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:01:56.982389 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:56.982315    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m29dp\" (UniqueName: \"kubernetes.io/projected/55e22513-de1f-4a82-baa8-b2c0dc1582a4-kube-api-access-m29dp\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:01:57.033867 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.033842    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:01:57.034205 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.034183    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" containerName="test-curl-7080-140449691474736"
Jul 10 01:01:57.034251 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.034207    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" containerName="test-curl-7080-140449691474736"
Jul 10 01:01:57.034284 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.034276    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" containerName="test-curl-7080-140449691474736"
Jul 10 01:01:57.037195 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.037179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:57.041675 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.041654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:01:57.083633 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.083600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8j9\" (UniqueName: \"kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9\") pod \"test-curl-7080-140449693591424\" (UID: \"9a5914e4-fb96-4462-a5e3-b5a6197379b8\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:57.184429 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.184392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8j9\" (UniqueName: \"kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9\") pod \"test-curl-7080-140449693591424\" (UID: \"9a5914e4-fb96-4462-a5e3-b5a6197379b8\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:57.194160 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.194131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8j9\" (UniqueName: \"kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9\") pod \"test-curl-7080-140449693591424\" (UID: \"9a5914e4-fb96-4462-a5e3-b5a6197379b8\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:57.347546 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.347450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:57.479632 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.479609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:01:57.481482 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:01:57.481455    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a5914e4_fb96_4462_a5e3_b5a6197379b8.slice/crio-e8f6676980aaefbe3e21060324f3a4475b9c4624c1f34c766eb12b1b5544efd1 WatchSource:0}: Error finding container e8f6676980aaefbe3e21060324f3a4475b9c4624c1f34c766eb12b1b5544efd1: Status 404 returned error can't find the container with id e8f6676980aaefbe3e21060324f3a4475b9c4624c1f34c766eb12b1b5544efd1
Jul 10 01:01:57.694713 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.694677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693591424" event={"ID":"9a5914e4-fb96-4462-a5e3-b5a6197379b8","Type":"ContainerStarted","Data":"e8f6676980aaefbe3e21060324f3a4475b9c4624c1f34c766eb12b1b5544efd1"}
Jul 10 01:01:57.696269 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.696227    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fe7106434976180d98fe712e11dca69fac6e64d9d13fb1a6d7c4b8b092139d6"
Jul 10 01:01:57.696405 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:57.696268    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:57.706986 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:01:57.706958    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7080-140449691474736\" is forbidden: User \"system:node:ip-10-0-141-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-199.ec2.internal' and this object" podUID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" pod="openshift-ingress/test-curl-7080-140449691474736"
Jul 10 01:01:58.191429 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:58.191394    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55e22513-de1f-4a82-baa8-b2c0dc1582a4" path="/var/lib/kubelet/pods/55e22513-de1f-4a82-baa8-b2c0dc1582a4/volumes"
Jul 10 01:01:58.702878 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:58.702817    2575 generic.go:356] "Generic (PLEG): container finished" podID="9a5914e4-fb96-4462-a5e3-b5a6197379b8" containerID="715c54738f5a3c37d8419eedcd1643ae68c8727a2bebe6d221919cf62379e528" exitCode=0
Jul 10 01:01:58.703079 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:58.702899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693591424" event={"ID":"9a5914e4-fb96-4462-a5e3-b5a6197379b8","Type":"ContainerDied","Data":"715c54738f5a3c37d8419eedcd1643ae68c8727a2bebe6d221919cf62379e528"}
Jul 10 01:01:59.838989 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.838966    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:01:59.858975 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.858952    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449693591424_9a5914e4-fb96-4462-a5e3-b5a6197379b8/test-curl-7080-140449693591424/0.log"
Jul 10 01:01:59.886558 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.886525    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:01:59.889533 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.889511    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:01:59.907514 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.907489    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k8j9\" (UniqueName: \"kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9\") pod \"9a5914e4-fb96-4462-a5e3-b5a6197379b8\" (UID: \"9a5914e4-fb96-4462-a5e3-b5a6197379b8\") "
Jul 10 01:01:59.910701 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:01:59.910676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9" (OuterVolumeSpecName: "kube-api-access-9k8j9") pod "9a5914e4-fb96-4462-a5e3-b5a6197379b8" (UID: "9a5914e4-fb96-4462-a5e3-b5a6197379b8"). InnerVolumeSpecName "kube-api-access-9k8j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:02:00.008445 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.008366    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k8j9\" (UniqueName: \"kubernetes.io/projected/9a5914e4-fb96-4462-a5e3-b5a6197379b8-kube-api-access-9k8j9\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:00.017885 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.017856    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:02:00.018201 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.018180    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a5914e4-fb96-4462-a5e3-b5a6197379b8" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:00.018250 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.018201    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a5914e4-fb96-4462-a5e3-b5a6197379b8" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:00.018285 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.018261    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a5914e4-fb96-4462-a5e3-b5a6197379b8" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:00.021270 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.021255    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.028111 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.028086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:02:00.109786 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.109745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2kqb\" (UniqueName: \"kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb\") pod \"test-curl-7080-140449693591424\" (UID: \"3d8b55f1-7817-4007-ada9-54f76deb53e4\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.191988 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.191958    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5914e4-fb96-4462-a5e3-b5a6197379b8" path="/var/lib/kubelet/pods/9a5914e4-fb96-4462-a5e3-b5a6197379b8/volumes"
Jul 10 01:02:00.211184 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.211155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2kqb\" (UniqueName: \"kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb\") pod \"test-curl-7080-140449693591424\" (UID: \"3d8b55f1-7817-4007-ada9-54f76deb53e4\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.218940 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.218914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2kqb\" (UniqueName: \"kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb\") pod \"test-curl-7080-140449693591424\" (UID: \"3d8b55f1-7817-4007-ada9-54f76deb53e4\") " pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.331747 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.331684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.458233 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.458207    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:02:00.460668 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:02:00.460641    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d8b55f1_7817_4007_ada9_54f76deb53e4.slice/crio-3072544c06d13be42fe819ffb3e3d62b9728cb3f06f21dd0f6171b86a121e150 WatchSource:0}: Error finding container 3072544c06d13be42fe819ffb3e3d62b9728cb3f06f21dd0f6171b86a121e150: Status 404 returned error can't find the container with id 3072544c06d13be42fe819ffb3e3d62b9728cb3f06f21dd0f6171b86a121e150
Jul 10 01:02:00.715784 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.715757    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:00.716000 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.715810    2575 scope.go:117] "RemoveContainer" containerID="715c54738f5a3c37d8419eedcd1643ae68c8727a2bebe6d221919cf62379e528"
Jul 10 01:02:00.717115 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:00.717008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693591424" event={"ID":"3d8b55f1-7817-4007-ada9-54f76deb53e4","Type":"ContainerStarted","Data":"3072544c06d13be42fe819ffb3e3d62b9728cb3f06f21dd0f6171b86a121e150"}
Jul 10 01:02:01.724587 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:01.724548    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d8b55f1-7817-4007-ada9-54f76deb53e4" containerID="ff4f0b99f4622de50051e5aff7d9bbc7dfad6b9c62fe33d400bc19e64c82d477" exitCode=0
Jul 10 01:02:01.725006 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:01.724637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693591424" event={"ID":"3d8b55f1-7817-4007-ada9-54f76deb53e4","Type":"ContainerDied","Data":"ff4f0b99f4622de50051e5aff7d9bbc7dfad6b9c62fe33d400bc19e64c82d477"}
Jul 10 01:02:02.867427 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.867405    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:02.888100 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.888074    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449693591424_3d8b55f1-7817-4007-ada9-54f76deb53e4/test-curl-7080-140449693591424/0.log"
Jul 10 01:02:02.910572 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.910536    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:02:02.912129 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.912105    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449693591424"]
Jul 10 01:02:02.934401 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.934374    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2kqb\" (UniqueName: \"kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb\") pod \"3d8b55f1-7817-4007-ada9-54f76deb53e4\" (UID: \"3d8b55f1-7817-4007-ada9-54f76deb53e4\") "
Jul 10 01:02:02.936564 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:02.936533    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb" (OuterVolumeSpecName: "kube-api-access-k2kqb") pod "3d8b55f1-7817-4007-ada9-54f76deb53e4" (UID: "3d8b55f1-7817-4007-ada9-54f76deb53e4"). InnerVolumeSpecName "kube-api-access-k2kqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:02:03.035645 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.035563    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2kqb\" (UniqueName: \"kubernetes.io/projected/3d8b55f1-7817-4007-ada9-54f76deb53e4-kube-api-access-k2kqb\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:03.045705 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.045676    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:03.046095 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.046079    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:03.046182 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.046098    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:03.046257 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.046186    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" containerName="test-curl-7080-140449693591424"
Jul 10 01:02:03.049042 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.049024    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:03.054688 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.054667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:03.136011 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.135980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xzjn\" (UniqueName: \"kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn\") pod \"test-curl-7080-140449693592432\" (UID: \"3952fb00-e179-4b00-b357-beca829c50ea\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:03.237207 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.237178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xzjn\" (UniqueName: \"kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn\") pod \"test-curl-7080-140449693592432\" (UID: \"3952fb00-e179-4b00-b357-beca829c50ea\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:03.244570 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.244538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xzjn\" (UniqueName: \"kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn\") pod \"test-curl-7080-140449693592432\" (UID: \"3952fb00-e179-4b00-b357-beca829c50ea\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:03.358991 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.358906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:03.488423 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.488384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:03.490541 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:02:03.490515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3952fb00_e179_4b00_b357_beca829c50ea.slice/crio-80713979b95dfba563fc6eecc1a43ffe198782a3a74f6c9d2f88d4852cab7e49 WatchSource:0}: Error finding container 80713979b95dfba563fc6eecc1a43ffe198782a3a74f6c9d2f88d4852cab7e49: Status 404 returned error can't find the container with id 80713979b95dfba563fc6eecc1a43ffe198782a3a74f6c9d2f88d4852cab7e49
Jul 10 01:02:03.736151 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.736125    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:03.736151 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.736144    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3072544c06d13be42fe819ffb3e3d62b9728cb3f06f21dd0f6171b86a121e150"
Jul 10 01:02:03.737285 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.737258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693592432" event={"ID":"3952fb00-e179-4b00-b357-beca829c50ea","Type":"ContainerStarted","Data":"80713979b95dfba563fc6eecc1a43ffe198782a3a74f6c9d2f88d4852cab7e49"}
Jul 10 01:02:03.746742 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:02:03.746716    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7080-140449693591424\" is forbidden: User \"system:node:ip-10-0-141-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-199.ec2.internal' and this object" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:03.874420 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:03.874390    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" podUID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" containerName="main" containerID="cri-o://152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c" gracePeriod=45
Jul 10 01:02:04.136419 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.136388    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:02:04.138850 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:02:04.138809    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7080-140449693591424\" is forbidden: User \"system:node:ip-10-0-141-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-199.ec2.internal' and this object" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" pod="openshift-ingress/test-curl-7080-140449693591424"
Jul 10 01:02:04.190862 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.190791    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8b55f1-7817-4007-ada9-54f76deb53e4" path="/var/lib/kubelet/pods/3d8b55f1-7817-4007-ada9-54f76deb53e4/volumes"
Jul 10 01:02:04.246553 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.246553 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246542    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.246777 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246563    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4fn7\" (UniqueName: \"kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.246777 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246586    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.246777 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246615    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.246777 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246642    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir\") pod \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\" (UID: \"2f27ce55-b161-4bd1-be5b-42c0d837a2fc\") "
Jul 10 01:02:04.247003 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:02:04.247003 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246901    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home" (OuterVolumeSpecName: "home") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:02:04.247003 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.246972    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:02:04.248702 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.248660    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm" (OuterVolumeSpecName: "dshm") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 01:02:04.248824 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.248739    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 01:02:04.248824 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.248759    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7" (OuterVolumeSpecName: "kube-api-access-k4fn7") pod "2f27ce55-b161-4bd1-be5b-42c0d837a2fc" (UID: "2f27ce55-b161-4bd1-be5b-42c0d837a2fc"). InnerVolumeSpecName "kube-api-access-k4fn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:02:04.347991 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.347953    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-model-cache\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.347991 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.347985    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4fn7\" (UniqueName: \"kubernetes.io/projected/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-kube-api-access-k4fn7\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.347991 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.347997    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-home\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.348221 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.348005    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tls-certs\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.348221 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.348015    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-tmp-dir\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.348221 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.348023    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f27ce55-b161-4bd1-be5b-42c0d837a2fc-dshm\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:04.743112 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.743074    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" containerID="152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c" exitCode=0
Jul 10 01:02:04.743301 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.743123    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"
Jul 10 01:02:04.743301 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.743162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" event={"ID":"2f27ce55-b161-4bd1-be5b-42c0d837a2fc","Type":"ContainerDied","Data":"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"}
Jul 10 01:02:04.743301 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.743206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw" event={"ID":"2f27ce55-b161-4bd1-be5b-42c0d837a2fc","Type":"ContainerDied","Data":"2a26843b46b13fb333449581356d3917dba685c41941a915938738ed76a5f355"}
Jul 10 01:02:04.743301 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.743225    2575 scope.go:117] "RemoveContainer" containerID="152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"
Jul 10 01:02:04.744784 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.744756    2575 generic.go:356] "Generic (PLEG): container finished" podID="3952fb00-e179-4b00-b357-beca829c50ea" containerID="852ca98485daa93ea4c0713d50cc32bc725a2bd305e1c96d9e01b98e115161d7" exitCode=0
Jul 10 01:02:04.744923 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.744790    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693592432" event={"ID":"3952fb00-e179-4b00-b357-beca829c50ea","Type":"ContainerDied","Data":"852ca98485daa93ea4c0713d50cc32bc725a2bd305e1c96d9e01b98e115161d7"}
Jul 10 01:02:04.751929 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.751912    2575 scope.go:117] "RemoveContainer" containerID="152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"
Jul 10 01:02:04.752187 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:02:04.752168    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c\": container with ID starting with 152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c not found: ID does not exist" containerID="152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"
Jul 10 01:02:04.752238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.752198    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c"} err="failed to get container status \"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c\": rpc error: code = NotFound desc = could not find container \"152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c\": container with ID starting with 152bf6eb1738feeb7c3cd3872283a3394e767a2217b47f9b02ca47c419b0180c not found: ID does not exist"
Jul 10 01:02:04.779299 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.779262    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:02:04.780797 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:04.780770    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-df95cf/rate-test-model-df95cf-kserve-69d455f4c-shdpw"]
Jul 10 01:02:05.892141 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.892117    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:05.911370 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.911343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449693592432_3952fb00-e179-4b00-b357-beca829c50ea/test-curl-7080-140449693592432/0.log"
Jul 10 01:02:05.935338 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.935303    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:05.939123 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.939097    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:05.959746 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.959721    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xzjn\" (UniqueName: \"kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn\") pod \"3952fb00-e179-4b00-b357-beca829c50ea\" (UID: \"3952fb00-e179-4b00-b357-beca829c50ea\") "
Jul 10 01:02:05.961774 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:05.961750    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn" (OuterVolumeSpecName: "kube-api-access-6xzjn") pod "3952fb00-e179-4b00-b357-beca829c50ea" (UID: "3952fb00-e179-4b00-b357-beca829c50ea"). InnerVolumeSpecName "kube-api-access-6xzjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:02:06.061378 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.061282    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xzjn\" (UniqueName: \"kubernetes.io/projected/3952fb00-e179-4b00-b357-beca829c50ea-kube-api-access-6xzjn\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:06.062578 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062555    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:06.062919 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062906    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3952fb00-e179-4b00-b357-beca829c50ea" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:06.062957 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062920    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3952fb00-e179-4b00-b357-beca829c50ea" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:06.062957 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062933    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" containerName="main"
Jul 10 01:02:06.062957 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062939    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" containerName="main"
Jul 10 01:02:06.063046 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062989    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" containerName="main"
Jul 10 01:02:06.063046 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.062998    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3952fb00-e179-4b00-b357-beca829c50ea" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:06.066024 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.066010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.071681 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.071655    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:06.162483 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.162444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvtjq\" (UniqueName: \"kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq\") pod \"test-curl-7080-140449693592432\" (UID: \"37ce7335-ae23-4e5c-a327-3e220c69d9b4\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.192092 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.192063    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f27ce55-b161-4bd1-be5b-42c0d837a2fc" path="/var/lib/kubelet/pods/2f27ce55-b161-4bd1-be5b-42c0d837a2fc/volumes"
Jul 10 01:02:06.192467 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.192450    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3952fb00-e179-4b00-b357-beca829c50ea" path="/var/lib/kubelet/pods/3952fb00-e179-4b00-b357-beca829c50ea/volumes"
Jul 10 01:02:06.263106 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.263064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtjq\" (UniqueName: \"kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq\") pod \"test-curl-7080-140449693592432\" (UID: \"37ce7335-ae23-4e5c-a327-3e220c69d9b4\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.271353 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.271322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvtjq\" (UniqueName: \"kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq\") pod \"test-curl-7080-140449693592432\" (UID: \"37ce7335-ae23-4e5c-a327-3e220c69d9b4\") " pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.375541 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.375455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.501456 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.501309    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:06.504034 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:02:06.504008    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37ce7335_ae23_4e5c_a327_3e220c69d9b4.slice/crio-8cceee6be1eb9a28120c2714692a764f6a521032430c1eeb5fb9dbe6698ec1e2 WatchSource:0}: Error finding container 8cceee6be1eb9a28120c2714692a764f6a521032430c1eeb5fb9dbe6698ec1e2: Status 404 returned error can't find the container with id 8cceee6be1eb9a28120c2714692a764f6a521032430c1eeb5fb9dbe6698ec1e2
Jul 10 01:02:06.756217 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.756188    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:06.756425 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.756197    2575 scope.go:117] "RemoveContainer" containerID="852ca98485daa93ea4c0713d50cc32bc725a2bd305e1c96d9e01b98e115161d7"
Jul 10 01:02:06.757526 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:06.757350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693592432" event={"ID":"37ce7335-ae23-4e5c-a327-3e220c69d9b4","Type":"ContainerStarted","Data":"8cceee6be1eb9a28120c2714692a764f6a521032430c1eeb5fb9dbe6698ec1e2"}
Jul 10 01:02:07.764048 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:07.764001    2575 generic.go:356] "Generic (PLEG): container finished" podID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" containerID="841bddf80fd3b8057681d6145159b892b546dce551a13892aba4cf43e78b338f" exitCode=0
Jul 10 01:02:07.764477 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:07.764087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7080-140449693592432" event={"ID":"37ce7335-ae23-4e5c-a327-3e220c69d9b4","Type":"ContainerDied","Data":"841bddf80fd3b8057681d6145159b892b546dce551a13892aba4cf43e78b338f"}
Jul 10 01:02:08.912573 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.912544    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:08.931184 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.931155    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7080-140449693592432_37ce7335-ae23-4e5c-a327-3e220c69d9b4/test-curl-7080-140449693592432/0.log"
Jul 10 01:02:08.952673 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.952641    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:08.954354 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.954333    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7080-140449693592432"]
Jul 10 01:02:08.988802 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.988768    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvtjq\" (UniqueName: \"kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq\") pod \"37ce7335-ae23-4e5c-a327-3e220c69d9b4\" (UID: \"37ce7335-ae23-4e5c-a327-3e220c69d9b4\") "
Jul 10 01:02:08.990863 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:08.990826    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq" (OuterVolumeSpecName: "kube-api-access-bvtjq") pod "37ce7335-ae23-4e5c-a327-3e220c69d9b4" (UID: "37ce7335-ae23-4e5c-a327-3e220c69d9b4"). InnerVolumeSpecName "kube-api-access-bvtjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 01:02:09.090151 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:09.090066    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvtjq\" (UniqueName: \"kubernetes.io/projected/37ce7335-ae23-4e5c-a327-3e220c69d9b4-kube-api-access-bvtjq\") on node \"ip-10-0-141-199.ec2.internal\" DevicePath \"\""
Jul 10 01:02:09.775705 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:09.775676    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cceee6be1eb9a28120c2714692a764f6a521032430c1eeb5fb9dbe6698ec1e2"
Jul 10 01:02:09.775705 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:09.775677    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:09.785388 ip-10-0-141-199 kubenswrapper[2575]: E0710 01:02:09.785360    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7080-140449693592432\" is forbidden: User \"system:node:ip-10-0-141-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-199.ec2.internal' and this object" podUID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" pod="openshift-ingress/test-curl-7080-140449693592432"
Jul 10 01:02:10.192441 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:10.192407    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" path="/var/lib/kubelet/pods/37ce7335-ae23-4e5c-a327-3e220c69d9b4/volumes"
Jul 10 01:02:13.434658 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:13.434627    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:02:23.605753 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:23.605712    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf9df8c4c-8csfv_0bcef067-b907-4045-b329-c98be2e9e37f/authorino/0.log"
Jul 10 01:02:25.329043 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:25.329009    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kzp67"]
Jul 10 01:02:29.571655 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:29.571627    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d875657f-lsrnl_f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19/copy-manifests/0.log"
Jul 10 01:02:29.590685 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:29.590648    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d875657f-lsrnl_f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19/manager/0.log"
Jul 10 01:02:31.573988 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:31.573951    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf9df8c4c-8csfv_0bcef067-b907-4045-b329-c98be2e9e37f/authorino/0.log"
Jul 10 01:02:31.937765 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:31.937739    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kjcqz_54205b1e-e77d-4fb5-bfc9-38dbb6b1625b/kuadrant-console-plugin/0.log"
Jul 10 01:02:32.332602 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:32.332520    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kzp67_df26d271-6f50-49da-8571-f63c9bac23aa/limitador/0.log"
Jul 10 01:02:33.214676 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:33.214639    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77865f7b8-srmxg_c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3/kube-auth-proxy/0.log"
Jul 10 01:02:34.318411 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:34.318380    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jvvps_c822542c-d62b-4620-ba9a-e02d1ae7bb11/main/0.log"
Jul 10 01:02:34.673276 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:34.673249    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wzqpk_8936b134-ff05-46da-896d-4340de27fdd1/main/0.log"
Jul 10 01:02:42.075215 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:42.075183    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-czjs4_940c64ff-1336-490c-8ce0-42f2ad0fdedb/global-pull-secret-syncer/0.log"
Jul 10 01:02:42.229938 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:42.229909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p6pqz_04f0a9e2-9f73-4203-9631-e2e610dc272a/konnectivity-agent/0.log"
Jul 10 01:02:42.288726 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:42.288688    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-199.ec2.internal_d58ff4672371e2d87fef8bb390ed631a/haproxy/0.log"
Jul 10 01:02:46.980932 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:46.980900    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf9df8c4c-8csfv_0bcef067-b907-4045-b329-c98be2e9e37f/authorino/0.log"
Jul 10 01:02:47.080009 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:47.079974    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-kjcqz_54205b1e-e77d-4fb5-bfc9-38dbb6b1625b/kuadrant-console-plugin/0.log"
Jul 10 01:02:47.317812 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:47.317697    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kzp67_df26d271-6f50-49da-8571-f63c9bac23aa/limitador/0.log"
Jul 10 01:02:49.273004 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.272924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65666bdb99-mkbxz_04f67c5d-8f47-45a7-b29c-43e695de6e9d/metrics-server/0.log"
Jul 10 01:02:49.484425 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.484399    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww4jd_ee0ce80b-1e4e-47b6-b736-de757d50e9ee/node-exporter/0.log"
Jul 10 01:02:49.520816 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.520786    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww4jd_ee0ce80b-1e4e-47b6-b736-de757d50e9ee/kube-rbac-proxy/0.log"
Jul 10 01:02:49.546285 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.546214    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww4jd_ee0ce80b-1e4e-47b6-b736-de757d50e9ee/init-textfile/0.log"
Jul 10 01:02:49.686142 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.686114    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/prometheus/0.log"
Jul 10 01:02:49.718213 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.718175    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/config-reloader/0.log"
Jul 10 01:02:49.740445 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.740417    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/thanos-sidecar/0.log"
Jul 10 01:02:49.764066 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.764026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/kube-rbac-proxy-web/0.log"
Jul 10 01:02:49.784466 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.784445    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/kube-rbac-proxy/0.log"
Jul 10 01:02:49.805751 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.805669    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/kube-rbac-proxy-thanos/0.log"
Jul 10 01:02:49.827987 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.827958    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d806529-1357-40f8-8efd-dfe56b006dc4/init-config-reloader/0.log"
Jul 10 01:02:49.928822 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.928796    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f565978fc-7xhp7_99980b3a-db95-4a3b-913c-f2ff61e20c21/telemeter-client/0.log"
Jul 10 01:02:49.952407 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.952384    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f565978fc-7xhp7_99980b3a-db95-4a3b-913c-f2ff61e20c21/reload/0.log"
Jul 10 01:02:49.971785 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:49.971761    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f565978fc-7xhp7_99980b3a-db95-4a3b-913c-f2ff61e20c21/kube-rbac-proxy/0.log"
Jul 10 01:02:52.002359 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.002330    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 01:02:52.010234 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.010209    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/3.log"
Jul 10 01:02:52.483927 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.483892    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"]
Jul 10 01:02:52.484224 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.484212    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:52.484274 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.484226    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:52.484309 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.484289    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ce7335-ae23-4e5c-a327-3e220c69d9b4" containerName="test-curl-7080-140449693592432"
Jul 10 01:02:52.487599 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.487580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.490190 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.490165    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cvbh\"/\"kube-root-ca.crt\""
Jul 10 01:02:52.490317 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.490193    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6cvbh\"/\"openshift-service-ca.crt\""
Jul 10 01:02:52.491267 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.491250    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6cvbh\"/\"default-dockercfg-njqvb\""
Jul 10 01:02:52.495481 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.495460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"]
Jul 10 01:02:52.570131 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.570097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-sys\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.570309 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.570137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-lib-modules\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.570309 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.570264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-podres\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.570309 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.570298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-proc\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.570435 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.570323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4s9d\" (UniqueName: \"kubernetes.io/projected/9e9db78d-fb5f-42f2-96da-c6115c861972-kube-api-access-n4s9d\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671054 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-sys\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-lib-modules\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-podres\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-proc\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4s9d\" (UniqueName: \"kubernetes.io/projected/9e9db78d-fb5f-42f2-96da-c6115c861972-kube-api-access-n4s9d\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-sys\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671238 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-proc\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671493 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-podres\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.671493 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.671313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9db78d-fb5f-42f2-96da-c6115c861972-lib-modules\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.678687 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.678667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4s9d\" (UniqueName: \"kubernetes.io/projected/9e9db78d-fb5f-42f2-96da-c6115c861972-kube-api-access-n4s9d\") pod \"perf-node-gather-daemonset-w2vws\" (UID: \"9e9db78d-fb5f-42f2-96da-c6115c861972\") " pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.797823 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.797745    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:52.931458 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.931433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"]
Jul 10 01:02:52.933849 ip-10-0-141-199 kubenswrapper[2575]: W0710 01:02:52.933807    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e9db78d_fb5f_42f2_96da_c6115c861972.slice/crio-f2e94a238ecd6fe8c38e249382b3c2877380944875a45f9cdd564cb838ce2e84 WatchSource:0}: Error finding container f2e94a238ecd6fe8c38e249382b3c2877380944875a45f9cdd564cb838ce2e84: Status 404 returned error can't find the container with id f2e94a238ecd6fe8c38e249382b3c2877380944875a45f9cdd564cb838ce2e84
Jul 10 01:02:52.982558 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:52.982528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws" event={"ID":"9e9db78d-fb5f-42f2-96da-c6115c861972","Type":"ContainerStarted","Data":"f2e94a238ecd6fe8c38e249382b3c2877380944875a45f9cdd564cb838ce2e84"}
Jul 10 01:02:53.216855 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:53.216808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-lx6wn_b7e1be45-306f-433b-94e4-4f37639557df/volume-data-source-validator/0.log"
Jul 10 01:02:53.988709 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:53.988675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws" event={"ID":"9e9db78d-fb5f-42f2-96da-c6115c861972","Type":"ContainerStarted","Data":"0f060d44330cab0071a17b9a209594f6ecd6b5eb2d3d1d38870a1a282db29b98"}
Jul 10 01:02:53.988893 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:53.988803    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:02:54.004884 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.004819    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws" podStartSLOduration=2.004799815 podStartE2EDuration="2.004799815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 01:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 01:02:54.003524282 +0000 UTC m=+2698.488815596" watchObservedRunningTime="2026-07-10 01:02:54.004799815 +0000 UTC m=+2698.490091107"
Jul 10 01:02:54.275046 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.274966    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hw6tv_16fdeb06-489c-4076-b5ce-ee9bb619611b/dns/0.log"
Jul 10 01:02:54.293817 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.293785    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hw6tv_16fdeb06-489c-4076-b5ce-ee9bb619611b/kube-rbac-proxy/0.log"
Jul 10 01:02:54.335629 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.335596    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pqqjj_56a71be3-f920-4543-8aca-caaa777619e1/dns-node-resolver/0.log"
Jul 10 01:02:54.891144 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.891110    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74db7c95b8-8vcm6_7252300c-3de8-424d-bbec-8a70a5998c51/registry/0.log"
Jul 10 01:02:54.955007 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:54.954980    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r97px_6ae6ac8e-6b2c-4d63-a3e3-19e0204c99c0/node-ca/0.log"
Jul 10 01:02:56.106345 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.106307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77865f7b8-srmxg_c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3/kube-auth-proxy/0.log"
Jul 10 01:02:56.258966 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.258933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 01:02:56.265445 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.265424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-9vgd4_85c9c187-dc0b-4f7e-88fa-d856239bdb7f/console-operator/2.log"
Jul 10 01:02:56.267015 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.266988    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 01:02:56.272450 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.272435    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zth6x_520a3cbc-2f67-48b8-bf8b-29fb329f2586/ovn-acl-logging/0.log"
Jul 10 01:02:56.904193 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:56.904153    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clh6w_4b4ee644-afb1-49d9-87a7-d49900f2a54d/serve-healthcheck-canary/0.log"
Jul 10 01:02:57.430262 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:57.430228    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rwbz_b871c525-2361-441d-8376-5934c37069e1/kube-rbac-proxy/0.log"
Jul 10 01:02:57.449195 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:57.449172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rwbz_b871c525-2361-441d-8376-5934c37069e1/exporter/0.log"
Jul 10 01:02:57.469457 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:02:57.469434    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5rwbz_b871c525-2361-441d-8376-5934c37069e1/extractor/0.log"
Jul 10 01:03:00.003454 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:00.003426    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6cvbh/perf-node-gather-daemonset-w2vws"
Jul 10 01:03:00.290396 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:00.290312    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d875657f-lsrnl_f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19/manager/0.log"
Jul 10 01:03:00.305518 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:00.305491    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85d875657f-lsrnl_f9c36d4b-1bcf-46b0-9453-6c2f2aa54f19/copy-manifests/0.log"
Jul 10 01:03:01.672894 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:01.672855    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56d4fb96db-pp9gz_d0912047-cb74-4b54-9cdc-cc2ae2b46693/manager/0.log"
Jul 10 01:03:02.433588 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:02.433542    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77865f7b8-srmxg_c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3/kube-auth-proxy/0.log"
Jul 10 01:03:03.874971 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:03.874933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77865f7b8-srmxg_c0ee5f17-e7f9-4421-ba8c-0a6932aa8ac3/kube-auth-proxy/0.log"
Jul 10 01:03:06.865496 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:06.865465    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vlqx2_8d7de5cc-3c9f-479b-80a5-40179774e9ec/migrator/0.log"
Jul 10 01:03:06.885486 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:06.885457    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-vlqx2_8d7de5cc-3c9f-479b-80a5-40179774e9ec/graceful-termination/0.log"
Jul 10 01:03:08.217170 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.217144    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/kube-multus-additional-cni-plugins/0.log"
Jul 10 01:03:08.240071 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.240050    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/egress-router-binary-copy/0.log"
Jul 10 01:03:08.259399 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.259378    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/cni-plugins/0.log"
Jul 10 01:03:08.278695 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.278677    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/bond-cni-plugin/0.log"
Jul 10 01:03:08.297913 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.297896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/routeoverride-cni/0.log"
Jul 10 01:03:08.318656 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.318636    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/whereabouts-cni-bincopy/0.log"
Jul 10 01:03:08.340537 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.340517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4bnl6_071727e1-8d42-48ba-b5f7-9f9ef22d5781/whereabouts-cni/0.log"
Jul 10 01:03:08.669011 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.668923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gdv5d_19d7be9b-40c7-4a9d-b928-95e629872529/kube-multus/0.log"
Jul 10 01:03:08.842085 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.842055    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhs8w_5a795161-ed87-4547-94f9-1cf3a22652bf/network-metrics-daemon/0.log"
Jul 10 01:03:08.858005 ip-10-0-141-199 kubenswrapper[2575]: I0710 01:03:08.857979    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qhs8w_5a795161-ed87-4547-94f9-1cf3a22652bf/kube-rbac-proxy/0.log"