Jul 23 18:04:25.361310 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 18:04:25.361325 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 18:04:25.361334 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 18:04:25.361886 ip-10-0-143-244 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 18:04:35.610315 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 18:04:35.610334 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e9e06f7391dc465aa9da0532002407c0 --
Jul 23 18:06:28.774014 ip-10-0-143-244 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 18:06:29.130899 ip-10-0-143-244 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:06:29.130899 ip-10-0-143-244 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 18:06:29.130899 ip-10-0-143-244 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:06:29.130899 ip-10-0-143-244 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 18:06:29.130899 ip-10-0-143-244 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:06:29.132995 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.132880    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 18:06:29.139017 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139002    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.139017 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139017    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139020    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139024    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139027    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139030    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139033    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139036    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139039    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139042    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139044    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139047    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139050    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139052    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139055    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139058    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139061    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139063    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139065    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139068    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.139083 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139070    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139073    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139075    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139077    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139080    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139082    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139084    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139087    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139090    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139093    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139096    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139099    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139101    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139103    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139106    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139110    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139114    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139126    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139130    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.139581 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139132    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139135    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139137    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139140    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139142    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139145    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139147    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139150    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139159    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139161    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139164    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139166    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139168    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139172    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139176    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139179    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139182    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139185    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139187    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139190    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.140056 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139192    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139195    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139197    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139199    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139202    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139205    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139207    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139209    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139212    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139214    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139216    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139219    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139227    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139230    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139232    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139235    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139237    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139240    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139243    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139247    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.140534 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139250    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139252    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139254    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139257    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139259    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139261    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139264    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139269    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139271    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139274    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139276    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139279    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139282    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139284    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139286    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139289    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139291    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139294    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139296    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.139299    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.141029 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140872    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140880    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140883    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140887    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140891    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140901    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140904    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140907    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140910    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140912    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140915    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140918    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140920    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140923    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140925    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140928    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140930    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140933    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140937    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.141510 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140940    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140943    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140945    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140949    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140953    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140956    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140959    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140962    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140964    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140967    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140969    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140971    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140974    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140976    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140979    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140982    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140984    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140987    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140989    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.140997    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.141993 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141000    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141003    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141005    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141008    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141010    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141012    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141015    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141017    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141020    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141022    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141024    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141027    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141030    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141032    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141035    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141037    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141040    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141042    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141045    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141047    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.142579 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141051    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141053    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141055    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141058    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141060    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141063    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141065    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141068    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141070    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141072    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141075    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141077    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141085    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141088    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141090    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141093    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141095    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141097    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141102    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.143098 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141105    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141108    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141110    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141114    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141117    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141119    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141122    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141124    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141127    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141129    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141131    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141134    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141136    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141139    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141142    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141144    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141147    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141149    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141152    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141154    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.143573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141156    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141513    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141517    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141520    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141523    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141526    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141528    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141531    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141533    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141536    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141539    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141543    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141545    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141548    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141551    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141554    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141556    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141560    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141563    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.144072 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141567    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141569    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141572    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141575    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141577    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141580    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141582    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141585    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141587    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141589    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141592    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141594    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141596    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141599    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141601    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141604    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141606    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141608    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141611    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141615    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.144573 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141617    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141619    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141622    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141624    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141627    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141629    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141631    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141634    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141637    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141641    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141644    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141646    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141649    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141651    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141654    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141657    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141659    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141662    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141664    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.145074 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141666    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141670    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141672    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141675    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141678    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141680    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141683    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141685    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141687    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141690    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141692    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141695    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141697    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141700    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141702    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141705    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141707    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141709    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141712    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141714    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.145535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141717    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141720    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141740    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141743    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141747    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141751    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141754    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141757    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141759    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141762    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141765    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141768    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141771    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141774    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141776    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141779    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141782    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141785    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141787    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141790    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.146059 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141793    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.141796    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141863    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141870    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141877    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141882    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141886    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141889    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141893    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141897    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141900    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141903    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141906    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141909    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141914    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141917    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141920    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141922    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141925    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141928    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141932    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141935    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141937    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141940    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 18:06:29.146535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141943    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141947    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141949    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141952    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141955    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141958    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141961    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141963    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141966    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141969    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141973    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141976    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141979    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141982    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141985    2579 flags.go:64] FLAG: --enable-server="true"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141988    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141993    2579 flags.go:64] FLAG: --event-burst="100"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141996    2579 flags.go:64] FLAG: --event-qps="50"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.141999    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142002    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142005    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142008    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142012    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142015    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142018    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 23 18:06:29.147128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142021    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142023    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142026    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142029    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142031    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142034    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142036    2579 flags.go:64] FLAG: --feature-gates=""
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142040    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142043    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142046    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142048    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142051    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142054    2579 flags.go:64] FLAG: --help="false"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142057    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142060    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142063    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142065    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142068    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142071    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142075    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142078    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142080    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142083    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 18:06:29.147741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142086    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142089    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142091    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142094    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142097    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142100    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142103    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142106    2579 flags.go:64] FLAG: --lock-file=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142109    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142112    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142115    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142120    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142123    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142125    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142128    2579 flags.go:64] FLAG: --logging-format="text"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142131    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142134    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142137    2579 flags.go:64] FLAG: --manifest-url=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142140    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142144    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142146    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142151    2579 flags.go:64] FLAG: --max-pods="110"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142153    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142156    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142159    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 18:06:29.148317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142161    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142164    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142167    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142171    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142177    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142180    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142183    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142185    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142188    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142194    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142197    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142200    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142202    2579 flags.go:64] FLAG: --port="10250"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142205    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142211    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c957a0d7c58a780f"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142214    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142217    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142220    2579 flags.go:64] FLAG: --register-node="true"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142223    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142227    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142229    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142232    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142235    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142238    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142241    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 18:06:29.149007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142243    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142246    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142249    2579 flags.go:64] FLAG: --runonce="false"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142252    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142254    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142257    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142260    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142262    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142265    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142268    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142273    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142275    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142278    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142281    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142283    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142286    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142289    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142292    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142297    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142300    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142302    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142307    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142310    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142312    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142316    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 18:06:29.150140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142319    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142321    2579 flags.go:64] FLAG: --v="2"
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142325    2579 flags.go:64] FLAG: --version="false"
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142334    2579 flags.go:64] FLAG: --vmodule=""
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142337    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.142340    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142446    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142449    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142452    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142454    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142457    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142459    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142462    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142464    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142467    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142470    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142472    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142476    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142479    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142481    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142484    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.151217 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142486    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142489    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142491    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142494    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142498    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142502    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142505    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142509    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142512    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142515    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142517    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142520    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142523    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142526    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142529    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142531    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142535    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142538    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142541    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.152164 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142543    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142546    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142548    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142551    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142553    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142555    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142558    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142560    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142562    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142566    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142569    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142572    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142574    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142577    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142579    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142582    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142585    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142587    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142590    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142593    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.153012 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142596    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142598    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142601    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142603    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142606    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142608    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142611    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142613    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142616    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142618    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142621    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142623    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142625    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142628    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142631    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142633    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142636    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142638    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142640    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142643    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.153650 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142645    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142650    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142653    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142656    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142659    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142661    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142663    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142666    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142668    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142671    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142673    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142676    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142678    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142681    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142683    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142685    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142688    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142690    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142692    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142695    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.154396 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142697    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142700    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142702    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142704    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.142707    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.143559    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.151684    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.151701    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.151749    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.151758    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151854    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151862    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151868    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151873    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151878    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.155285 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151882    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151886    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151893    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151898    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151904    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151908    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151912    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151924    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151928    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151932    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151936    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151940    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151944    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151948    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151952    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151957    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151961    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151965    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151969    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151973    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.155761 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151977    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151982    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151986    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151991    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151995    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.151999    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152003    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152007    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152011    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152015    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152019    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152023    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152028    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152032    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152038    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152043    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152048    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152053    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152057    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.156395 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152062    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152074    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152078    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152081    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152085    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152090    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152094    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152098    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152102    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152106    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152110    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152114    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152118    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152122    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152126    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152130    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152135    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152141    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152146    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152150    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.156925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152154    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152159    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152162    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152166    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152170    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152173    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152177    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152181    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152184    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152188    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152192    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152196    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152200    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152204    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152216    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152220    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152224    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152228    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152232    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152236    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.157418 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152240    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152244    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152248    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152252    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152256    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152260    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152264    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152268    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152273    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152277    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152281    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152286    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152289    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152293    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152297    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.158088 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.152305    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152577    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152586    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152591    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152595    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152600    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152604    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152611    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152617    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152621    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152625    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152630    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152641    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152646    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152651    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152655    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152659    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152662    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152666    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:06:29.158493 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152670    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152675    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152679    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152682    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152686    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152691    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152696    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152701    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152705    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152709    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152713    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152717    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152721    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152742    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152747    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152751    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152755    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152758    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152762    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152767    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:06:29.158981 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152771    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152775    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152779    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152783    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152786    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152790    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152802    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152807    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152811    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152815    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152819    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152823    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152827    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152831    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152835    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152839    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152845    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152850    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152856    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152861    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:06:29.159785 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152865    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152869    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152874    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152878    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152882    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152886    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152890    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152894    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152898    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152902    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152906    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152911    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152915    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152919    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152923    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152926    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152930    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152934    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152938    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:06:29.160509 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152950    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152957    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152961    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152965    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152969    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152973    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152977    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152981    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152985    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152990    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.152994    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153001    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153005    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153009    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153013    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153017    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153020    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153024    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153028    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:06:29.161032 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153032    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153036    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:29.153040    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.153048    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.153201    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.156150    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.157628    2579 server.go:1019] "Starting client certificate rotation"
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.157743    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:06:29.161501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.157774    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:06:29.162670 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.162653    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:06:29.163973 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.163957    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:06:29.174260 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.174245    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 23 18:06:29.176370 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.176355    2579 log.go:25] "Validated CRI v1 image API"
Jul 23 18:06:29.177505 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.177482    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 18:06:29.179809 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.179790    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9ddd36af-9bd4-423e-9bfd-9963df753ebb:/dev/nvme0n1p3 dafc849f-de41-428f-addc-38e03656111c:/dev/nvme0n1p4]
Jul 23 18:06:29.179878 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.179808    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 18:06:29.186630 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.186524    2579 manager.go:216] Machine: {Timestamp:2026-07-23 18:06:29.185341842 +0000 UTC m=+0.304826194 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099286 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23e66a49e9ce0adcdf8e5cb9147e90 SystemUUID:ec23e66a-49e9-ce0a-dcdf-8e5cb9147e90 BootID:e9e06f73-91dc-465a-a9da-0532002407c0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:b7:65:92:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:b7:65:92:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:f3:db:26:b6:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 18:06:29.186630 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.186624    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 18:06:29.186750 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.186693    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 18:06:29.190043 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.190027    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:06:29.190469 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.190443    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 18:06:29.190592 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.190474    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 18:06:29.191781 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.191766    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 18:06:29.191781 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.191780    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 18:06:29.191896 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.191794    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:06:29.192508 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.192497    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:06:29.194002 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.193992    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 18:06:29.197946 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.197936    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:06:29.198114 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198105    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 18:06:29.198144 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198136    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 18:06:29.198170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198151    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 18:06:29.198170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198165    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 18:06:29.198225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198174    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 23 18:06:29.198225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198182    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 18:06:29.198498 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198483    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:06:29.198563 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.198505    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:06:29.200415 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.200400    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 18:06:29.202929 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.202916    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 18:06:29.202973 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.202947    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 18:06:29.204155 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204144    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 18:06:29.204188 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204160    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 18:06:29.204188 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204166    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 18:06:29.204188 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204173    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204191    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204197    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204205    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204211    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204217    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204222    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204237    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 18:06:29.204279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204242    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 18:06:29.204894 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204885    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 18:06:29.204894 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.204894    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 18:06:29.208485 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.208458    2579 server.go:1268] "Started kubelet"
Jul 23 18:06:29.208688 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.208642    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 18:06:29.208785 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.208706    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 18:06:29.209224 ip-10-0-143-244 systemd[1]: Started Kubernetes Kubelet.
Jul 23 18:06:29.209519 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.209489    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 18:06:29.212322 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.212307    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 18:06:29.213253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.213235    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 18:06:29.213760 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.213722    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 18:06:29.213760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.213755    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 18:06:29.213898 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.213760    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 18:06:29.213999 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.213980    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 18:06:29.214838 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.213940    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18c4fd6b333b92d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-07-23 18:06:29.208429268 +0000 UTC m=+0.327913628,LastTimestamp:2026-07-23 18:06:29.208429268 +0000 UTC m=+0.327913628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
Jul 23 18:06:29.220079 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.220054    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 18:06:29.220222 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.220048    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 18:06:29.220912 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.220891    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.221256 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221232    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 18:06:29.221356 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221261    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 18:06:29.221356 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221286    2579 factory.go:55] Registering systemd factory
Jul 23 18:06:29.221356 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221230    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 18:06:29.221356 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221301    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 23 18:06:29.221518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221370    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 18:06:29.221518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221388    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 18:06:29.221740 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221540    2579 factory.go:153] Registering CRI-O factory
Jul 23 18:06:29.221740 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221551    2579 factory.go:223] Registration of the crio container factory successfully
Jul 23 18:06:29.221740 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221594    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 18:06:29.221740 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221612    2579 factory.go:103] Registering Raw factory
Jul 23 18:06:29.221740 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.221621    2579 manager.go:1196] Started watching for new ooms in manager
Jul 23 18:06:29.222178 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.222162    2579 manager.go:349] Starting recovery of all containers
Jul 23 18:06:29.222998 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.222970    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 18:06:29.223092 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.222992    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 18:06:29.232180 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.232165    2579 manager.go:354] Recovery completed
Jul 23 18:06:29.237443 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.237349    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.239458 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.239437    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.239518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.239476    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.239518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.239488    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.240000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.239981    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 18:06:29.240106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.240001    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 18:06:29.240106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.240020    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:06:29.240106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.239987    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.240791 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.240770    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.240845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.240800    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.240845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.240813    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.242165 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.242154    2579 policy_none.go:49] "None policy: Start"
Jul 23 18:06:29.242217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.242171    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 18:06:29.242217 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.242180    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 18:06:29.244110 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.244100    2579 policy_none.go:47] "Start"
Jul 23 18:06:29.251562 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.251546    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdpg6"
Jul 23 18:06:29.251885 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.251823    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18c4fd6b351505f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-07-23 18:06:29.239457271 +0000 UTC m=+0.358941628,LastTimestamp:2026-07-23 18:06:29.239457271 +0000 UTC m=+0.358941628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
Jul 23 18:06:29.261599 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.261578    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdpg6"
Jul 23 18:06:29.264218 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.264157    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18c4fd6b351566c7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-244.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-07-23 18:06:29.239482055 +0000 UTC m=+0.358966406,LastTimestamp:2026-07-23 18:06:29.239482055 +0000 UTC m=+0.358966406,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
Jul 23 18:06:29.279767 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.279755    2579 manager.go:337] "Starting Device Plugin manager"
Jul 23 18:06:29.279835 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.279781    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 18:06:29.279835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.279793    2579 server.go:87] "Starting device plugin registration server"
Jul 23 18:06:29.279987 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.279974    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 18:06:29.280024 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.279988    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 18:06:29.280123 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.280100    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 18:06:29.280251 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.280184    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 18:06:29.280251 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.280194    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 18:06:29.280679 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.280660    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 18:06:29.280770 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.280714    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.349268 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.349237    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 18:06:29.351433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.350536    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 18:06:29.351433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.350565    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 18:06:29.351433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.350584    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 18:06:29.351433 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.350616    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 18:06:29.352813 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.352798    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:06:29.380689 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.380671    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.381395 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.381354    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.381395 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.381387    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.381518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.381413    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.381518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.381441    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.391670 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.391656    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.391719 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.391677    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-244.ec2.internal\": node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.422198 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.422175    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.450853 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.450832    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"]
Jul 23 18:06:29.450910 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.450888    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.452209 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.452195    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.452257 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.452221    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.452257 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.452231    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.454460 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.454449    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.454578 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.454564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.454617 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.454592    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.455179 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455162    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.455179 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455172    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.455303 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455190    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.455303 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455195    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.455303 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455201    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.455303 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.455209    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.457471 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.457454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.457552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.457485    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:06:29.458191 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.458175    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:06:29.458268 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.458207    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:06:29.458268 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.458223    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:06:29.480280 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.480261    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.484502 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.484486    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.522424 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.522402    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.523274 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.523254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.523339 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.523306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.523339 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.523334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86f9821a2022aa66ebb58ac7570e2dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"86f9821a2022aa66ebb58ac7570e2dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.622776 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.622752    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.623868 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.623853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.623921 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.623904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.623955 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.623932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.623986 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.623956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86f9821a2022aa66ebb58ac7570e2dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"86f9821a2022aa66ebb58ac7570e2dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.624015 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.623983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86f9821a2022aa66ebb58ac7570e2dc3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"86f9821a2022aa66ebb58ac7570e2dc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.624052 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.624022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc5d5d27d123ec86b22a7318732c5ce7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"fc5d5d27d123ec86b22a7318732c5ce7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.723402 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.723359    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.784603 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.784588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.787756 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:29.787742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:29.823442 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.823422    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:29.923838 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:29.923819    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:30.024358 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:30.024314    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:31.514802 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.514766    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Jul 23 18:06:31.546995 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.546973    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 18:06:31.547319 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.547093    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:06:31.578529 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.578504    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:06:31.589168 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.589147    2579 apiserver.go:52] "Watching apiserver"
Jul 23 18:06:31.599832 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.599202    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 18:06:31.600439 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.600130    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-cbr8b","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48","openshift-cluster-node-tuning-operator/tuned-7dxdc","openshift-network-diagnostics/network-check-target-hmd4g","openshift-network-operator/iptables-alerter-6lqw5","kube-system/global-pull-secret-syncer-qv8nx","kube-system/konnectivity-agent-bzbhh","openshift-dns/node-resolver-rvcxt","openshift-image-registry/node-ca-c8js9","openshift-multus/multus-56bdb","openshift-multus/multus-additional-cni-plugins-fkdjz","openshift-multus/network-metrics-daemon-dcmvx"]
Jul 23 18:06:31.603128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.603113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:31.603209 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.603191    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:31.605639 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.605621    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.607919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.607901    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.608058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.607973    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 18:06:31.608058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.607993    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.608340 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.608322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.608521 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.608503    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m9z8f\""
Jul 23 18:06:31.610269 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.610246    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 18:06:31.610647 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.610630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.610695 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.610646    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.611063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.611047    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:31.611148 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.611134    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gvxct\""
Jul 23 18:06:31.611361 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.611348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.613391 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.613377    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.615645 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615627    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.615645 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615637    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 18:06:31.615804 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615656    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.615804 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.615982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f44b0cd6-0e92-4aa2-b099-17084090001a-hosts-file\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.615982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-serviceca\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.616087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615987    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.616087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.615997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-k8s-cni-cncf-io\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-bin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-hostroot\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7596\" (UniqueName: \"kubernetes.io/projected/73d2d3d7-6e05-491d-968f-5923db1ef48a-kube-api-access-l7596\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-system-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-conf-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8sb\" (UniqueName: \"kubernetes.io/projected/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-kube-api-access-bx8sb\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616148    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qzh48\""
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c995v\" (UniqueName: \"kubernetes.io/projected/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-kube-api-access-c995v\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-socket-dir-parent\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-kubelet\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-daemon-config\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-multus-certs\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d2d3d7-6e05-491d-968f-5923db1ef48a-iptables-alerter-script\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cni-binary-copy\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vrmgl\""
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-multus\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d2d3d7-6e05-491d-968f-5923db1ef48a-host-slash\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxtz\" (UniqueName: \"kubernetes.io/projected/f44b0cd6-0e92-4aa2-b099-17084090001a-kube-api-access-6wxtz\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.616835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616538    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-os-release\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-netns\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-etc-kubernetes\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44b0cd6-0e92-4aa2-b099-17084090001a-tmp-dir\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-host\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cnibin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.617365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.616749    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.618669 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.618646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.618737 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.618710    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:31.620025 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.620009    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 18:06:31.620127 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.620040    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 18:06:31.620188 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.620124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5985h\""
Jul 23 18:06:31.621052 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.621039    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.623306 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.623289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.623768 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.623753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 18:06:31.623884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.623865    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:06:31.624965 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.624947    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.625099 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625025    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 18:06:31.625246 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625228    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 18:06:31.625374 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625257    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.625440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625378    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jxgdx\""
Jul 23 18:06:31.625484 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625472    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 18:06:31.625817 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 18:06:31.625917 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625902    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.625995 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.625949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.626583 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.626568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v96p8\""
Jul 23 18:06:31.627141 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.627113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.628536 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.628520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.628629 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.628572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:31.629091 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.629072    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:06:31.629372 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.629356    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-96ddn\""
Jul 23 18:06:31.629464 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.629377    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 18:06:31.630906 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.630884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.630982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.630954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"]
Jul 23 18:06:31.632820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.631677    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:06:31.632820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.631839    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Jul 23 18:06:31.634264 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.634246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 18:06:31.634378 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.634362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zszvg\""
Jul 23 18:06:31.638518 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.638487    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 18:06:31.641906 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.641873    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"]
Jul 23 18:06:31.641994 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.641907    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:06:31.654125 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.654102    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cz4zb"
Jul 23 18:06:31.657385 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.657352    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:01:30 +0000 UTC" deadline="2028-03-18 09:14:45.60379438 +0000 UTC"
Jul 23 18:06:31.657444 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.657384    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14487h8m13.946412379s"
Jul 23 18:06:31.663239 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.663217    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cz4zb"
Jul 23 18:06:31.711992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.711967    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 18:06:31.716874 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-os-release\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.716972 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-node-log\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.716972 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmcnx\" (UniqueName: \"kubernetes.io/projected/86c0b31b-ae11-467d-b665-68cda81fab1b-kube-api-access-kmcnx\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.716972 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1db4f78f-c6e8-48dd-959e-0be812cfdec0-agent-certs\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.716972 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-run\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.717138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.716983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.717138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-cnibin\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.717138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.717138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.717138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-config\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d2d3d7-6e05-491d-968f-5923db1ef48a-host-slash\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-etc-kubernetes\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-etc-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d2d3d7-6e05-491d-968f-5923db1ef48a-host-slash\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-etc-kubernetes\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-conf\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44b0cd6-0e92-4aa2-b099-17084090001a-tmp-dir\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cnibin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-sys\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cnibin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-tmp\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.717417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f44b0cd6-0e92-4aa2-b099-17084090001a-hosts-file\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-k8s-cni-cncf-io\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-bin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f44b0cd6-0e92-4aa2-b099-17084090001a-hosts-file\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-hostroot\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-k8s-cni-cncf-io\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-hostroot\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-bin\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7596\" (UniqueName: \"kubernetes.io/projected/73d2d3d7-6e05-491d-968f-5923db1ef48a-kube-api-access-l7596\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-conf-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8sb\" (UniqueName: \"kubernetes.io/projected/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-kube-api-access-bx8sb\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-netd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-conf-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-modprobe-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f44b0cd6-0e92-4aa2-b099-17084090001a-tmp-dir\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-slash\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-bin\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1db4f78f-c6e8-48dd-959e-0be812cfdec0-konnectivity-ca\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-socket-dir-parent\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-daemon-config\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-multus-certs\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-socket-dir-parent\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.717998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-multus-certs\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvwz\" (UniqueName: \"kubernetes.io/projected/c3daaab7-d095-49df-bb42-684d6f408100-kube-api-access-qdvwz\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-systemd-units\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d2d3d7-6e05-491d-968f-5923db1ef48a-iptables-alerter-script\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-daemon-config\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cni-binary-copy\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-multus\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.718803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr78\" (UniqueName: \"kubernetes.io/projected/184befdb-289c-447e-b8c6-2ceece197b4b-kube-api-access-thr78\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-var-lib-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c0b31b-ae11-467d-b665-68cda81fab1b-ovn-node-metrics-cert\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-cni-multus\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-script-lib\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysconfig\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-lib-modules\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-var-lib-kubelet\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-etc-tuned\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxtz\" (UniqueName: \"kubernetes.io/projected/f44b0cd6-0e92-4aa2-b099-17084090001a-kube-api-access-6wxtz\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-os-release\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-netns\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.718995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d2d3d7-6e05-491d-968f-5923db1ef48a-iptables-alerter-script\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719027    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-log-socket\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-systemd\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.719550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-cni-binary-copy\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-dbus\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-os-release\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-host\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-systemd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719258    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-ovn\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-serviceca\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-netns\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkrl\" (UniqueName: \"kubernetes.io/projected/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kube-api-access-4jkrl\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-system-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-kubelet-config\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c995v\" (UniqueName: \"kubernetes.io/projected/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-kube-api-access-c995v\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.720588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-env-overrides\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-host\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-run-netns\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-kubelet\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-kubelet\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-kubernetes\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtxss\" (UniqueName: \"kubernetes.io/projected/733fa127-f766-420c-a563-a09c6938dbf7-kube-api-access-gtxss\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-serviceca\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-system-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.719954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-host\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.720121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-host-var-lib-kubelet\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.721255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.720187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-multus-cni-dir\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.728490 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.728473    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 18:06:31.729834 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.729813    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:31.729945 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.729843    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:31.729945 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.729860    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:31.729945 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.729939    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:32.229918008 +0000 UTC m=+1.959350522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:31.731455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.731434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8sb\" (UniqueName: \"kubernetes.io/projected/a3528d10-d2dc-4866-9ec3-e0e4398fe8d2-kube-api-access-bx8sb\") pod \"multus-56bdb\" (UID: \"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2\") " pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.731455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.731448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxtz\" (UniqueName: \"kubernetes.io/projected/f44b0cd6-0e92-4aa2-b099-17084090001a-kube-api-access-6wxtz\") pod \"node-resolver-rvcxt\" (UID: \"f44b0cd6-0e92-4aa2-b099-17084090001a\") " pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.731564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.731437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7596\" (UniqueName: \"kubernetes.io/projected/73d2d3d7-6e05-491d-968f-5923db1ef48a-kube-api-access-l7596\") pod \"iptables-alerter-6lqw5\" (UID: \"73d2d3d7-6e05-491d-968f-5923db1ef48a\") " pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.732667 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.732651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c995v\" (UniqueName: \"kubernetes.io/projected/a4bb8a44-9c96-4570-bb4d-8824ef5607c9-kube-api-access-c995v\") pod \"node-ca-c8js9\" (UID: \"a4bb8a44-9c96-4570-bb4d-8824ef5607c9\") " pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.742054 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.742026    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5d5d27d123ec86b22a7318732c5ce7.slice/crio-69d087c07a4c73537cace4455b9d209b0b3d3756354eec3a2cde71dd5c0c768d WatchSource:0}: Error finding container 69d087c07a4c73537cace4455b9d209b0b3d3756354eec3a2cde71dd5c0c768d: Status 404 returned error can't find the container with id 69d087c07a4c73537cace4455b9d209b0b3d3756354eec3a2cde71dd5c0c768d
Jul 23 18:06:31.746958 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.746941    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:06:31.820074 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thr78\" (UniqueName: \"kubernetes.io/projected/184befdb-289c-447e-b8c6-2ceece197b4b-kube-api-access-thr78\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.820172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-var-lib-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c0b31b-ae11-467d-b665-68cda81fab1b-ovn-node-metrics-cert\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-script-lib\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.820172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysconfig\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-var-lib-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-lib-modules\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-var-lib-kubelet\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-etc-tuned\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysconfig\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-log-socket\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-log-socket\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-systemd\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-var-lib-kubelet\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-lib-modules\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-dbus\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-systemd\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-systemd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.820407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-dbus\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-ovn\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-systemd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-netns\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-ovn\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-netns\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkrl\" (UniqueName: \"kubernetes.io/projected/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kube-api-access-4jkrl\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-sys-fs\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-kubelet-config\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-env-overrides\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-host\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-kubelet\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.821404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-kubernetes\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtxss\" (UniqueName: \"kubernetes.io/projected/733fa127-f766-420c-a563-a09c6938dbf7-kube-api-access-gtxss\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-host\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.820933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-script-lib\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-kubelet-config\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-os-release\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-kubelet\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-kubernetes\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-os-release\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-node-log\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmcnx\" (UniqueName: \"kubernetes.io/projected/86c0b31b-ae11-467d-b665-68cda81fab1b-kube-api-access-kmcnx\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1db4f78f-c6e8-48dd-959e-0be812cfdec0-agent-certs\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.822250 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-run\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-node-log\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-env-overrides\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-cnibin\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-run\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.821523    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-cnibin\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.821611    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:32.321595012 +0000 UTC m=+2.051027525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-config\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-etc-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/184befdb-289c-447e-b8c6-2ceece197b4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821737    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-conf\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.822979 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-sys\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-tmp\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.821807    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-socket-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:31.821859    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:32.321844847 +0000 UTC m=+2.051277365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-netd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-sysctl-conf\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-modprobe-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.821963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-sys\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-run-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-slash\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/733fa127-f766-420c-a563-a09c6938dbf7-etc-modprobe-d\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-bin\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822084    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-slash\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1db4f78f-c6e8-48dd-959e-0be812cfdec0-konnectivity-ca\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.823482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvwz\" (UniqueName: \"kubernetes.io/projected/c3daaab7-d095-49df-bb42-684d6f408100-kube-api-access-qdvwz\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-bin\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-systemd-units\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-host-cni-netd\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86c0b31b-ae11-467d-b665-68cda81fab1b-ovnkube-config\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-etc-openvswitch\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-registration-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86c0b31b-ae11-467d-b665-68cda81fab1b-systemd-units\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-device-dir\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1db4f78f-c6e8-48dd-959e-0be812cfdec0-konnectivity-ca\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/184befdb-289c-447e-b8c6-2ceece197b4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86c0b31b-ae11-467d-b665-68cda81fab1b-ovn-node-metrics-cert\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.823961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.822916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-etc-tuned\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.824457 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.823922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733fa127-f766-420c-a563-a09c6938dbf7-tmp\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.825049 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.825033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1db4f78f-c6e8-48dd-959e-0be812cfdec0-agent-certs\") pod \"konnectivity-agent-bzbhh\" (UID: \"1db4f78f-c6e8-48dd-959e-0be812cfdec0\") " pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:31.837056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.837039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmcnx\" (UniqueName: \"kubernetes.io/projected/86c0b31b-ae11-467d-b665-68cda81fab1b-kube-api-access-kmcnx\") pod \"ovnkube-node-cbr8b\" (UID: \"86c0b31b-ae11-467d-b665-68cda81fab1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:31.837442 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.837422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtxss\" (UniqueName: \"kubernetes.io/projected/733fa127-f766-420c-a563-a09c6938dbf7-kube-api-access-gtxss\") pod \"tuned-7dxdc\" (UID: \"733fa127-f766-420c-a563-a09c6938dbf7\") " pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:31.837521 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.837499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr78\" (UniqueName: \"kubernetes.io/projected/184befdb-289c-447e-b8c6-2ceece197b4b-kube-api-access-thr78\") pod \"multus-additional-cni-plugins-fkdjz\" (UID: \"184befdb-289c-447e-b8c6-2ceece197b4b\") " pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.837859 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.837845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvwz\" (UniqueName: \"kubernetes.io/projected/c3daaab7-d095-49df-bb42-684d6f408100-kube-api-access-qdvwz\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:31.838058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.838042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkrl\" (UniqueName: \"kubernetes.io/projected/1a1beaf8-95a1-41b9-8b13-582f3ecb73f1-kube-api-access-4jkrl\") pod \"aws-ebs-csi-driver-node-k7h48\" (UID: \"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:31.932844 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.932767    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6lqw5"
Jul 23 18:06:31.942319 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.942298    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d2d3d7_6e05_491d_968f_5923db1ef48a.slice/crio-7dd02997a4147a177667263685bb6ac0c4819da9d2f2ada42ad9280f855b8034 WatchSource:0}: Error finding container 7dd02997a4147a177667263685bb6ac0c4819da9d2f2ada42ad9280f855b8034: Status 404 returned error can't find the container with id 7dd02997a4147a177667263685bb6ac0c4819da9d2f2ada42ad9280f855b8034
Jul 23 18:06:31.942903 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.942888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvcxt"
Jul 23 18:06:31.951267 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.951249    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44b0cd6_0e92_4aa2_b099_17084090001a.slice/crio-dc92eacf776909fcb86869cdb1807664b084cb2309b888f3ed92eabed1c7dda8 WatchSource:0}: Error finding container dc92eacf776909fcb86869cdb1807664b084cb2309b888f3ed92eabed1c7dda8: Status 404 returned error can't find the container with id dc92eacf776909fcb86869cdb1807664b084cb2309b888f3ed92eabed1c7dda8
Jul 23 18:06:31.952813 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.952797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c8js9"
Jul 23 18:06:31.960654 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.960634    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bb8a44_9c96_4570_bb4d_8824ef5607c9.slice/crio-ccbc6d9d00cac66920e6b9a4ef12a260501828019a7f7019aaffb8da0f019273 WatchSource:0}: Error finding container ccbc6d9d00cac66920e6b9a4ef12a260501828019a7f7019aaffb8da0f019273: Status 404 returned error can't find the container with id ccbc6d9d00cac66920e6b9a4ef12a260501828019a7f7019aaffb8da0f019273
Jul 23 18:06:31.970141 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.970125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56bdb"
Jul 23 18:06:31.975882 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.975862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkdjz"
Jul 23 18:06:31.977288 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.977271    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3528d10_d2dc_4866_9ec3_e0e4398fe8d2.slice/crio-5cbbe57b7c906b9a7eb6cdcf823ba704f8a36a4a519f154d5e8c8dbe7c93de86 WatchSource:0}: Error finding container 5cbbe57b7c906b9a7eb6cdcf823ba704f8a36a4a519f154d5e8c8dbe7c93de86: Status 404 returned error can't find the container with id 5cbbe57b7c906b9a7eb6cdcf823ba704f8a36a4a519f154d5e8c8dbe7c93de86
Jul 23 18:06:31.983806 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:31.983768    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184befdb_289c_447e_b8c6_2ceece197b4b.slice/crio-b21cc15d8fa74ee2189717d883cf398de9921256fcfbe6c5ba6e625bb344dff6 WatchSource:0}: Error finding container b21cc15d8fa74ee2189717d883cf398de9921256fcfbe6c5ba6e625bb344dff6: Status 404 returned error can't find the container with id b21cc15d8fa74ee2189717d883cf398de9921256fcfbe6c5ba6e625bb344dff6
Jul 23 18:06:31.999834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:31.999819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:32.007639 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:32.007619    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c0b31b_ae11_467d_b665_68cda81fab1b.slice/crio-a2b8aa4020f03833306ba1e553da53c004fbf23718ef8b138a00eddc46eb7677 WatchSource:0}: Error finding container a2b8aa4020f03833306ba1e553da53c004fbf23718ef8b138a00eddc46eb7677: Status 404 returned error can't find the container with id a2b8aa4020f03833306ba1e553da53c004fbf23718ef8b138a00eddc46eb7677
Jul 23 18:06:32.010802 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.010769    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:06:32.020589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.020567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48"
Jul 23 18:06:32.027933 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:32.027916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1beaf8_95a1_41b9_8b13_582f3ecb73f1.slice/crio-d39f337d73f7b445bf87e88954286760dfbdaa59b766ec353227a8cc8a7ec10d WatchSource:0}: Error finding container d39f337d73f7b445bf87e88954286760dfbdaa59b766ec353227a8cc8a7ec10d: Status 404 returned error can't find the container with id d39f337d73f7b445bf87e88954286760dfbdaa59b766ec353227a8cc8a7ec10d
Jul 23 18:06:32.043850 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.043834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dxdc"
Jul 23 18:06:32.047661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.047646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:32.051497 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:32.051472    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733fa127_f766_420c_a563_a09c6938dbf7.slice/crio-5d40de28480da79c5f61b639f389c2f1e3bb12ea9dc4c04411c9b6a0e1b6fcaf WatchSource:0}: Error finding container 5d40de28480da79c5f61b639f389c2f1e3bb12ea9dc4c04411c9b6a0e1b6fcaf: Status 404 returned error can't find the container with id 5d40de28480da79c5f61b639f389c2f1e3bb12ea9dc4c04411c9b6a0e1b6fcaf
Jul 23 18:06:32.056612 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:32.056591    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db4f78f_c6e8_48dd_959e_0be812cfdec0.slice/crio-ab57a4f1c00a65f0105c01b96858458a0c1a0ebb1e98c2bfa6b7d0f53e4cc3d4 WatchSource:0}: Error finding container ab57a4f1c00a65f0105c01b96858458a0c1a0ebb1e98c2bfa6b7d0f53e4cc3d4: Status 404 returned error can't find the container with id ab57a4f1c00a65f0105c01b96858458a0c1a0ebb1e98c2bfa6b7d0f53e4cc3d4
Jul 23 18:06:32.081527 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.080687    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:06:32.325727 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.325644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:32.325727 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.325693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.325733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325828    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325869    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325892    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325901    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.325881243 +0000 UTC m=+3.055313742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325908    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325921    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:32.325942 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325925    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.325909492 +0000 UTC m=+3.055341991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:32.326237 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:32.325970    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:33.325956097 +0000 UTC m=+3.055388614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:32.445357 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:06:32.445327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f9821a2022aa66ebb58ac7570e2dc3.slice/crio-38be68857a89f1ee5624b66ce682942e68dca026f1a9c9c4cbb5d2c68c82fe91 WatchSource:0}: Error finding container 38be68857a89f1ee5624b66ce682942e68dca026f1a9c9c4cbb5d2c68c82fe91: Status 404 returned error can't find the container with id 38be68857a89f1ee5624b66ce682942e68dca026f1a9c9c4cbb5d2c68c82fe91
Jul 23 18:06:32.611720 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.611647    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:06:32.666089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.666009    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:31 +0000 UTC" deadline="2028-02-13 08:29:11.023388847 +0000 UTC"
Jul 23 18:06:32.666089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.666068    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13670h22m38.357325145s"
Jul 23 18:06:32.747188 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.747131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bzbhh" event={"ID":"1db4f78f-c6e8-48dd-959e-0be812cfdec0","Type":"ContainerStarted","Data":"ab57a4f1c00a65f0105c01b96858458a0c1a0ebb1e98c2bfa6b7d0f53e4cc3d4"}
Jul 23 18:06:32.750504 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.750472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dxdc" event={"ID":"733fa127-f766-420c-a563-a09c6938dbf7","Type":"ContainerStarted","Data":"5d40de28480da79c5f61b639f389c2f1e3bb12ea9dc4c04411c9b6a0e1b6fcaf"}
Jul 23 18:06:32.754641 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.754611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"a2b8aa4020f03833306ba1e553da53c004fbf23718ef8b138a00eddc46eb7677"}
Jul 23 18:06:32.758726 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.758698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerStarted","Data":"b21cc15d8fa74ee2189717d883cf398de9921256fcfbe6c5ba6e625bb344dff6"}
Jul 23 18:06:32.762368 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.762342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c8js9" event={"ID":"a4bb8a44-9c96-4570-bb4d-8824ef5607c9","Type":"ContainerStarted","Data":"ccbc6d9d00cac66920e6b9a4ef12a260501828019a7f7019aaffb8da0f019273"}
Jul 23 18:06:32.764490 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.764463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvcxt" event={"ID":"f44b0cd6-0e92-4aa2-b099-17084090001a","Type":"ContainerStarted","Data":"dc92eacf776909fcb86869cdb1807664b084cb2309b888f3ed92eabed1c7dda8"}
Jul 23 18:06:32.769159 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.769138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6lqw5" event={"ID":"73d2d3d7-6e05-491d-968f-5923db1ef48a","Type":"ContainerStarted","Data":"7dd02997a4147a177667263685bb6ac0c4819da9d2f2ada42ad9280f855b8034"}
Jul 23 18:06:32.773092 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.773058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"fc5d5d27d123ec86b22a7318732c5ce7","Type":"ContainerStarted","Data":"69d087c07a4c73537cace4455b9d209b0b3d3756354eec3a2cde71dd5c0c768d"}
Jul 23 18:06:32.777261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.777236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"86f9821a2022aa66ebb58ac7570e2dc3","Type":"ContainerStarted","Data":"38be68857a89f1ee5624b66ce682942e68dca026f1a9c9c4cbb5d2c68c82fe91"}
Jul 23 18:06:32.782323 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.782298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48" event={"ID":"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1","Type":"ContainerStarted","Data":"d39f337d73f7b445bf87e88954286760dfbdaa59b766ec353227a8cc8a7ec10d"}
Jul 23 18:06:32.785701 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:32.785677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56bdb" event={"ID":"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2","Type":"ContainerStarted","Data":"5cbbe57b7c906b9a7eb6cdcf823ba704f8a36a4a519f154d5e8c8dbe7c93de86"}
Jul 23 18:06:33.333921 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.333882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:33.334107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.333936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:33.334107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.333972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:33.334221 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334111    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:33.334221 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334131    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:33.334221 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334143    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:33.334221 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334201    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:35.334183934 +0000 UTC m=+5.063616431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:33.334635 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334607    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:33.334731 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334668    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:35.33465114 +0000 UTC m=+5.064083637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:33.334731 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334728    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:33.334864 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.334763    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:35.334750263 +0000 UTC m=+5.064182773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:33.666792 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.666690    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:31 +0000 UTC" deadline="2028-01-07 12:08:24.368391391 +0000 UTC"
Jul 23 18:06:33.666792 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.666731    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12786h1m50.701665127s"
Jul 23 18:06:33.741137 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.741082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:33.741286 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.741213    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:33.741632 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.741600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:33.741716 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.741693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:33.741806 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:33.741752    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:33.741880 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:33.741853    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:35.348464 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.348430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:35.348975 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.348489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:35.348975 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.348556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:35.348975 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.348668    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:35.348975 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.348725    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:39.34870646 +0000 UTC m=+9.078138959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:35.349295 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349121    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:35.349295 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349170    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:39.349154278 +0000 UTC m=+9.078586779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:35.349295 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349255    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:35.349295 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349273    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:35.349295 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349284    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:35.349527 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.349323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:39.349310803 +0000 UTC m=+9.078743304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:35.741575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.741454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:35.741749 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.741588    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:35.742019 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.741996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:35.742117 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.742096    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:35.742187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:35.742154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:35.742241 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:35.742228    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:37.741206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:37.741165    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:37.741727 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:37.741318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:37.741727 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:37.741329    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:37.741727 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:37.741348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:37.741727 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:37.741415    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:37.741727 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:37.741493    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:39.382363 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.382316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.382399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.382431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382462    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382484    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382497    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382509    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382555    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:47.382537683 +0000 UTC m=+17.111970197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382577    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382576    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:47.382566126 +0000 UTC m=+17.111998622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:39.382758 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.382611    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:47.38260138 +0000 UTC m=+17.112033876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:39.741530 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.741454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:39.741530 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.741482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:39.741704 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:39.741454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:39.741704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.741613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:39.742027 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.741993    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:39.742102 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:39.742056    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:41.741917 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:41.741880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:41.742370 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:41.741880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:41.742370 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:41.742018    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:41.742370 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:41.741880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:41.742370 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:41.742076    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:41.742370 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:41.742121    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:43.741598 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:43.741566    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:43.742045 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:43.741688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:43.742045 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:43.741700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:43.742045 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:43.741723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:43.742045 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:43.741843    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:43.742045 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:43.741950    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:45.741847 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:45.741812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:45.742300 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:45.741859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:45.742300 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:45.741859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:45.742300 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:45.741949    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:45.742300 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:45.742031    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:45.742300 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:45.742101    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:47.445245 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.445167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.445238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.445277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445368    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445374    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445393    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445407    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445431    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:03.445416456 +0000 UTC m=+33.174848953 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445374    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445457    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:03.445441516 +0000 UTC m=+33.174874017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:06:47.445684 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.445503    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:03.445489073 +0000 UTC m=+33.174921587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:06:47.741025 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.740948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:47.741025 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.740985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:47.741228 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:47.740957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:47.741228 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.741061    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:47.741228 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.741145    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:47.741375 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:47.741250    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:49.741853 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:49.741653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:49.742286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:49.741684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:49.742286 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:49.741943    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:49.742286 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:49.742044    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:49.742286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:49.741715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:49.742286 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:49.742132    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:51.741075 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.741049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:51.741426 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.741094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:51.741426 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.741172    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:51.741426 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:51.741194    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:51.741426 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:51.741241    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:51.741426 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:51.741291    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:51.826759 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.826698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"86f9821a2022aa66ebb58ac7570e2dc3","Type":"ContainerStarted","Data":"b4d4e83b6b96b263d957b6c012880e34da6af29513e1a8af6a5dc12512157c46"}
Jul 23 18:06:51.828000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.827976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dxdc" event={"ID":"733fa127-f766-420c-a563-a09c6938dbf7","Type":"ContainerStarted","Data":"d6dadaf154922dfe1ec887c5cfdaf4f38e9927e9b3eced8b034927a1b5125ddd"}
Jul 23 18:06:51.844534 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.844497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" podStartSLOduration=20.844486123 podStartE2EDuration="20.844486123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:51.844392235 +0000 UTC m=+21.573824745" watchObservedRunningTime="2026-07-23 18:06:51.844486123 +0000 UTC m=+21.573918641"
Jul 23 18:06:51.867706 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:51.867677    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7dxdc" podStartSLOduration=1.45184 podStartE2EDuration="20.867664761s" totalImagesPullingTime="19.415824761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:51.867311236 +0000 UTC m=+21.596743756" watchObservedRunningTime="2026-07-23 18:06:51.867664761 +0000 UTC m=+21.597097278"
Jul 23 18:06:52.830914 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.830614    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="969dd4236d40c0da24b4b03768be8228780cce3db91b0cec3992909b87a9547b" exitCode=0
Jul 23 18:06:52.831496 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.830699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"969dd4236d40c0da24b4b03768be8228780cce3db91b0cec3992909b87a9547b"}
Jul 23 18:06:52.832375 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.832354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c8js9" event={"ID":"a4bb8a44-9c96-4570-bb4d-8824ef5607c9","Type":"ContainerStarted","Data":"28c1324de3614d43d9ccd78e9dd024fe4dec3284a046b721b6cf79d18671a3b0"}
Jul 23 18:06:52.833684 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.833661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvcxt" event={"ID":"f44b0cd6-0e92-4aa2-b099-17084090001a","Type":"ContainerStarted","Data":"cefd7530507a1d364b20010ee717c2d949329686031aacbd5d3fde04d72b8f65"}
Jul 23 18:06:52.834975 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.834951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6lqw5" event={"ID":"73d2d3d7-6e05-491d-968f-5923db1ef48a","Type":"ContainerStarted","Data":"26a58e43749ddd75b6abf4da3b2ed39a1cf0e8d58246d968d2a02a6013999dc9"}
Jul 23 18:06:52.836377 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.836359    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc5d5d27d123ec86b22a7318732c5ce7" containerID="6cd9f49060afb442b71c01df24ad832cb00b9b79ccaa2bdf2accf640ba6460f2" exitCode=0
Jul 23 18:06:52.836526 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.836421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"fc5d5d27d123ec86b22a7318732c5ce7","Type":"ContainerDied","Data":"6cd9f49060afb442b71c01df24ad832cb00b9b79ccaa2bdf2accf640ba6460f2"}
Jul 23 18:06:52.837692 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.837675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48" event={"ID":"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1","Type":"ContainerStarted","Data":"d31c401d34bf0a0fbf2024ce26f991c89e49e6d100582c2629b9f460fb81950c"}
Jul 23 18:06:52.838983 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.838965    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56bdb" event={"ID":"a3528d10-d2dc-4866-9ec3-e0e4398fe8d2","Type":"ContainerStarted","Data":"80a3d69bbe32e7b138970214679ae729aaaf622224f2a1be60e5753824d3c473"}
Jul 23 18:06:52.840237 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.840219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bzbhh" event={"ID":"1db4f78f-c6e8-48dd-959e-0be812cfdec0","Type":"ContainerStarted","Data":"df0ef867e3ed494e58335ead35a89b37afd6d8da1bf6697f28a11499c0dc3b4b"}
Jul 23 18:06:52.842455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.842438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"dc801837513b1bb58a9192cd7c12e8beda7997e47afda9171f267b984bf75b82"}
Jul 23 18:06:52.842557 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.842488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"c7dcabffdd2512ce306e104adcf523738c43df1d04d080dd8bb96ff67736a955"}
Jul 23 18:06:52.842557 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.842516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"cbbc574169bb6fdcc11b7900f5439979a483fadca032c125d285f78bd9081c45"}
Jul 23 18:06:52.842557 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.842544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"421977ddad6a289eee12eae18b36c73cbd956fad6aae08564e27c85be3d9f7f6"}
Jul 23 18:06:52.885549 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.885507    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-56bdb" podStartSLOduration=2.997533316 podStartE2EDuration="22.885496155s" totalImagesPullingTime="19.887962839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.885338814 +0000 UTC m=+22.614771332" watchObservedRunningTime="2026-07-23 18:06:52.885496155 +0000 UTC m=+22.614928672"
Jul 23 18:06:52.902200 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.902168    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bzbhh" podStartSLOduration=11.644196069 podStartE2EDuration="21.902157262s" totalImagesPullingTime="10.257961193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.902097587 +0000 UTC m=+22.631530105" watchObservedRunningTime="2026-07-23 18:06:52.902157262 +0000 UTC m=+22.631589779"
Jul 23 18:06:52.919617 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.919573    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6lqw5" podStartSLOduration=3.393660635 podStartE2EDuration="22.9195622s" totalImagesPullingTime="19.525901565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.919192264 +0000 UTC m=+22.648624787" watchObservedRunningTime="2026-07-23 18:06:52.9195622 +0000 UTC m=+22.648994717"
Jul 23 18:06:52.954576 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:52.954547    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rvcxt" podStartSLOduration=7.7776101 podStartE2EDuration="22.954537192s" totalImagesPullingTime="15.176927092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.936910276 +0000 UTC m=+22.666342794" watchObservedRunningTime="2026-07-23 18:06:52.954537192 +0000 UTC m=+22.683969711"
Jul 23 18:06:53.189336 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.189246    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:53.189797 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.189758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:53.210567 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.210529    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c8js9" podStartSLOduration=8.043297037 podStartE2EDuration="23.210516499s" totalImagesPullingTime="15.167219462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:52.954738657 +0000 UTC m=+22.684171188" watchObservedRunningTime="2026-07-23 18:06:53.210516499 +0000 UTC m=+22.939949050"
Jul 23 18:06:53.741564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.741540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:53.741686 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.741584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:53.741686 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.741551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:53.741686 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:53.741661    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:53.741841 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:53.741753    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:53.741884 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:53.741844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:53.808208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.808184    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 18:06:53.846145 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.846120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48" event={"ID":"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1","Type":"ContainerStarted","Data":"6b0c013fd39bca92057439d8a90a6a986079a1e8ff86da49bdac962e3c40a8e2"}
Jul 23 18:06:53.849090 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.849062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"0039b554dde0f157226f6e1d67663956893a2c91b444f8865f9c42ca7bceb4ac"}
Jul 23 18:06:53.849190 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.849129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"74a9e53999bae9c2fffb5b065088a88bda830cc8e6ed8784adb57c1aa0f2c7dc"}
Jul 23 18:06:53.849800 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.849754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:53.850087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:53.850070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bzbhh"
Jul 23 18:06:54.687615 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:54.687490    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:06:53.808204156Z","UUID":"6752642e-35ae-4697-8d01-e0d25873028b","Handler":null,"Name":"","Endpoint":""}
Jul 23 18:06:54.689085 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:54.689059    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 18:06:54.689216 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:54.689107    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 18:06:54.853018 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:54.852972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"fc5d5d27d123ec86b22a7318732c5ce7","Type":"ContainerStarted","Data":"3d6988b6c2532bdbe04868a5c207ded2f96128357a1e95914e52dfb162e940f2"}
Jul 23 18:06:54.877600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:54.877548    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" podStartSLOduration=23.87753252 podStartE2EDuration="23.87753252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:54.877129326 +0000 UTC m=+24.606561845" watchObservedRunningTime="2026-07-23 18:06:54.87753252 +0000 UTC m=+24.606965037"
Jul 23 18:06:55.741449 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:55.741416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:55.741630 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:55.741455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:55.741630 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:55.741540    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:55.741852 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:55.741830    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:55.741994 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:55.741935    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:55.742064 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:55.741994    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:55.858916 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:55.858883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"04c57fda266e7d04d087ee245a161b8bac9bd84fbe82965e59334e788e4d51eb"}
Jul 23 18:06:57.741661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:57.741413    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:57.741661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:57.741449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:57.742117 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:57.741693    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:57.742117 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:57.741459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:57.742117 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:57.741762    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:57.742117 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:57.741840    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:58.873435 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.871332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" event={"ID":"86c0b31b-ae11-467d-b665-68cda81fab1b","Type":"ContainerStarted","Data":"2214f15e1d9578facbb502ffe52300210a024210a18bbb39d57173b6a3d1da93"}
Jul 23 18:06:58.873435 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.872504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:58.873435 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.872593    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:58.873435 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.872696    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:58.898753 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.897940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:58.902122 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.901871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:06:58.975189 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:58.975131    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b" podStartSLOduration=7.68341663 podStartE2EDuration="27.975117519s" totalImagesPullingTime="20.291700889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:58.927514334 +0000 UTC m=+28.656946863" watchObservedRunningTime="2026-07-23 18:06:58.975117519 +0000 UTC m=+28.704550038"
Jul 23 18:06:59.741914 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.741711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:06:59.742057 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.741744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:06:59.742057 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:59.741988    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:06:59.742129 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.741754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:06:59.742159 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:59.742053    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:06:59.742159 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:06:59.742138    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:06:59.875053 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.875023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48" event={"ID":"1a1beaf8-95a1-41b9-8b13-582f3ecb73f1","Type":"ContainerStarted","Data":"c8270c9f3e67ef125f2a4a316660f3f4139669987b40f050d9253362a7792bd6"}
Jul 23 18:06:59.876598 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.876573    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="e5662033fb3c76eb8ed8022e6ec479f1a59c049a87c1f7913797618a5a3a89c9" exitCode=0
Jul 23 18:06:59.876709 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.876635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"e5662033fb3c76eb8ed8022e6ec479f1a59c049a87c1f7913797618a5a3a89c9"}
Jul 23 18:06:59.936252 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:06:59.936204    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k7h48" podStartSLOduration=3.320739354 podStartE2EDuration="28.936191672s" totalImagesPullingTime="25.615452318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:59.906904325 +0000 UTC m=+29.636336842" watchObservedRunningTime="2026-07-23 18:06:59.936191672 +0000 UTC m=+29.665624190"
Jul 23 18:07:01.115451 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.115416    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qv8nx"]
Jul 23 18:07:01.115873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.115544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:01.115873 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:01.115659    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:07:01.120298 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.120275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmd4g"]
Jul 23 18:07:01.120410 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.120376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:01.120486 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:01.120468    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:07:01.121523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.121502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dcmvx"]
Jul 23 18:07:01.121759 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.121590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:01.121759 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:01.121678    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:07:01.883658 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.883581    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="c9d4b0d376a5273b200463594a3552180990d69eebcbf371c45de9a0005c28d5" exitCode=0
Jul 23 18:07:01.883658 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:01.883634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"c9d4b0d376a5273b200463594a3552180990d69eebcbf371c45de9a0005c28d5"}
Jul 23 18:07:02.741830 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:02.741804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:02.742219 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:02.741801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:02.742219 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:02.741896    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:07:02.742219 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:02.741922    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:02.742219 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:02.742013    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:07:02.742219 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:02.742118    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:07:03.464160 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:03.463945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:03.464280 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:03.464209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:03.464280 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464101    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:07:03.464280 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:03.464241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:03.464280 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464259    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:07:03.464280 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464275    2579 projected.go:196] Error preparing data for projected volume kube-api-access-4mq5r for pod openshift-network-diagnostics/network-check-target-hmd4g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:07:03.464425 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464328    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r podName:7f30513c-94bd-4303-8af3-bfdd37a57583 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:35.464309966 +0000 UTC m=+65.193742480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mq5r" (UniqueName: "kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r") pod "network-check-target-hmd4g" (UID: "7f30513c-94bd-4303-8af3-bfdd37a57583") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:07:03.464425 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464330    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:07:03.464425 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464365    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs podName:c3daaab7-d095-49df-bb42-684d6f408100 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:35.464355379 +0000 UTC m=+65.193787875 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs") pod "network-metrics-daemon-dcmvx" (UID: "c3daaab7-d095-49df-bb42-684d6f408100") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:07:03.464425 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464326    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:07:03.464425 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:03.464400    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret podName:3e709b8e-9dbd-4254-bb8d-b31c4e3592a8 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:35.464392588 +0000 UTC m=+65.193825086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret") pod "global-pull-secret-syncer-qv8nx" (UID: "3e709b8e-9dbd-4254-bb8d-b31c4e3592a8") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:07:03.890263 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:03.890232    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="c83536c722513c292d75fd19805c2e5a04523a9b78b82da8c98c4f227d2b4a86" exitCode=0
Jul 23 18:07:03.890611 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:03.890280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"c83536c722513c292d75fd19805c2e5a04523a9b78b82da8c98c4f227d2b4a86"}
Jul 23 18:07:04.741325 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:04.741301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:04.741325 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:04.741316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:04.741453 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:04.741316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:04.741453 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:04.741389    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmd4g" podUID="7f30513c-94bd-4303-8af3-bfdd37a57583"
Jul 23 18:07:04.741524 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:04.741481    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qv8nx" podUID="3e709b8e-9dbd-4254-bb8d-b31c4e3592a8"
Jul 23 18:07:04.741566 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:04.741550    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dcmvx" podUID="c3daaab7-d095-49df-bb42-684d6f408100"
Jul 23 18:07:05.078294 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.078220    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeReady"
Jul 23 18:07:05.078733 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.078355    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 18:07:05.130817 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.130763    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:07:05.145635 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.145608    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"]
Jul 23 18:07:05.145797 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.145754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.148744 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.148469    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 18:07:05.148744 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.148556    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 18:07:05.148744 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.148584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 18:07:05.149097 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.149077    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c6cqn\""
Jul 23 18:07:05.156961 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.156848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-54cdl"]
Jul 23 18:07:05.157058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.157008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"
Jul 23 18:07:05.165222 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.165094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.165222 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.165119    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.165474 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.165457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-klscj\""
Jul 23 18:07:05.172965 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.172940    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"]
Jul 23 18:07:05.173478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.173455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.179059 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.179035    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 18:07:05.179282 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.179261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lr8qz\""
Jul 23 18:07:05.182032 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.181723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.182254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.182239    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 18:07:05.182871 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.182609    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 18:07:05.185114 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.185094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.191745 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.191722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"]
Jul 23 18:07:05.191865 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.191765    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tgspg"]
Jul 23 18:07:05.191928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.191862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.196147 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.196118    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.196251 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.196210    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 18:07:05.196824 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.196542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztzjf\""
Jul 23 18:07:05.196824 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.196613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 18:07:05.196824 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.196636    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.204880 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.204861    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"]
Jul 23 18:07:05.205010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.204993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.209439 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.209418    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.209603 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.209584    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.209751 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.209730    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 18:07:05.210058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.210032    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 18:07:05.210355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.210336    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-m29t7\""
Jul 23 18:07:05.216079 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.216060    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 18:07:05.220149 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.220131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:07:05.220237 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.220167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78f5bc49b8-tr9lr"]
Jul 23 18:07:05.220275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.220243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.223607 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.223590    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 18:07:05.224863 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.224844    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.224948 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.224863    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 18:07:05.225003 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.224959    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.225003 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.224844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljrpj\""
Jul 23 18:07:05.234529 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.234511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"]
Jul 23 18:07:05.234644 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.234622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.238411 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.238390    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 18:07:05.239520 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.239499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 18:07:05.239613 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.239570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7qsmn\""
Jul 23 18:07:05.239863 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.239842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.239963 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.239875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 18:07:05.239963 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.239913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 18:07:05.240126 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.240110    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.245540 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.245519    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"]
Jul 23 18:07:05.245674 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.245653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.250154 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.249967    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 18:07:05.250154 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.250001    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.250694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.250678    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 18:07:05.250906 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.250893    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hw97s\""
Jul 23 18:07:05.252845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.252758    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.254568 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-54cdl"]
Jul 23 18:07:05.254643 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254585    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"]
Jul 23 18:07:05.254643 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"]
Jul 23 18:07:05.254643 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.254742 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tgspg"]
Jul 23 18:07:05.254742 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f5bc49b8-tr9lr"]
Jul 23 18:07:05.254742 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"]
Jul 23 18:07:05.254742 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.254709    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6tg5l"]
Jul 23 18:07:05.261701 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.261669    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-chlbw\""
Jul 23 18:07:05.261842 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.261826    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 18:07:05.261842 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.261837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.262145 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.262128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 18:07:05.262213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.262204    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.263305 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.263290    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"]
Jul 23 18:07:05.263423 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.263406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.265936 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.265920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfp27\""
Jul 23 18:07:05.266028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.265919    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 18:07:05.266163 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.266147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 18:07:05.272196 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.272173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-999l7"]
Jul 23 18:07:05.272281 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.272274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"
Jul 23 18:07:05.275068 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.275051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jg9kp\""
Jul 23 18:07:05.275441 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.275422    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.275920 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.275899    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.277993 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.277976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7b4\" (UniqueName: \"kubernetes.io/projected/d32b6713-12a0-47d6-9104-312f00de8047-kube-api-access-6k7b4\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.278063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.278208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-snapshots\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-service-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278324 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278324 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8wg\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278324 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278291    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977625e7-860e-4c7c-983e-c363dec5329a-serving-cert\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278324 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-config\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.278440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-serving-cert\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.278440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278573 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-tmp\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278573 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2htqc\" (UniqueName: \"kubernetes.io/projected/977625e7-860e-4c7c-983e-c363dec5329a-kube-api-access-2htqc\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.278573 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.278573 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-trusted-ca\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.278706 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx4lx\" (UniqueName: \"kubernetes.io/projected/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-kube-api-access-bx4lx\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.278706 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.278602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7xg\" (UniqueName: \"kubernetes.io/projected/295d0dbb-aaf0-4180-b016-3c969365f556-kube-api-access-2x7xg\") pod \"volume-data-source-validator-78cf4c6f6-k9ct9\" (UID: \"295d0dbb-aaf0-4180-b016-3c969365f556\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"
Jul 23 18:07:05.283004 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.282987    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"]
Jul 23 18:07:05.283114 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.283097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.293820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.293800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"]
Jul 23 18:07:05.293907 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.293837    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"]
Jul 23 18:07:05.293907 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.293852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.293994 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.293858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-999l7"]
Jul 23 18:07:05.294038 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.293994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tg5l"]
Jul 23 18:07:05.294038 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.294028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"]
Jul 23 18:07:05.302551 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.302533    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 18:07:05.302671 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.302622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 18:07:05.302869 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.302855    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mtn54\""
Jul 23 18:07:05.302951 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.302911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 18:07:05.306473 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.306431    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 18:07:05.307038 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.307015    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 18:07:05.307158 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.307140    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wr6v5\""
Jul 23 18:07:05.379195 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-trusted-ca\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.379195 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.379195 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.379439 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.379439 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.379821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.379907 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.379907 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fad7513-c439-4c95-9d24-bb3a24a04bcc-config\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhhnm\" (UniqueName: \"kubernetes.io/projected/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-kube-api-access-rhhnm\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-service-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8wg\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977625e7-860e-4c7c-983e-c363dec5329a-serving-cert\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.380010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.379993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p24v5\" (UniqueName: \"kubernetes.io/projected/5abd4122-6989-4780-bb88-cc36a881b421-kube-api-access-p24v5\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-serving-cert\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2htqc\" (UniqueName: \"kubernetes.io/projected/977625e7-860e-4c7c-983e-c363dec5329a-kube-api-access-2htqc\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-trusted-ca\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.380285 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.380560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5abd4122-6989-4780-bb88-cc36a881b421-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.380560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.380560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7xg\" (UniqueName: \"kubernetes.io/projected/295d0dbb-aaf0-4180-b016-3c969365f556-kube-api-access-2x7xg\") pod \"volume-data-source-validator-78cf4c6f6-k9ct9\" (UID: \"295d0dbb-aaf0-4180-b016-3c969365f556\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"
Jul 23 18:07:05.380560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-cert\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.380560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx4lx\" (UniqueName: \"kubernetes.io/projected/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-kube-api-access-bx4lx\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.380760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg85m\" (UniqueName: \"kubernetes.io/projected/7fad7513-c439-4c95-9d24-bb3a24a04bcc-kube-api-access-zg85m\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.380760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-service-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.380760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7b4\" (UniqueName: \"kubernetes.io/projected/d32b6713-12a0-47d6-9104-312f00de8047-kube-api-access-6k7b4\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.380760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnm9v\" (UniqueName: \"kubernetes.io/projected/16b9be93-3d12-4ebf-b3ec-2b303a535466-kube-api-access-fnm9v\") pod \"network-check-source-7bc5b6bf85-j9z5n\" (UID: \"16b9be93-3d12-4ebf-b3ec-2b303a535466\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"
Jul 23 18:07:05.380760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.381011 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-snapshots\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.381011 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977625e7-860e-4c7c-983e-c363dec5329a-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.381011 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.380904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.381168 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.381070    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:05.381168 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.381130    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.881113929 +0000 UTC m=+35.610546450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:05.381293 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-default-certificate\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.381407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.381407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fad7513-c439-4c95-9d24-bb3a24a04bcc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.381407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-snapshots\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.381407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-config\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e77422b-8dbe-4341-b061-b0bd8c933c2a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.381422    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.381436    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz7fj\" (UniqueName: \"kubernetes.io/projected/b983cccf-bb1c-431a-ab76-0a89e6ea9367-kube-api-access-sz7fj\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-config-volume\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.381476    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.881461745 +0000 UTC m=+35.610894261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-tmp-dir\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.381575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-stats-auth\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edb5cc0d-a911-4603-a27b-ae9041cdac85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-tmp\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edb5cc0d-a911-4603-a27b-ae9041cdac85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqrck\" (UniqueName: \"kubernetes.io/projected/edb5cc0d-a911-4603-a27b-ae9041cdac85-kube-api-access-rqrck\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hvcs\" (UniqueName: \"kubernetes.io/projected/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-kube-api-access-5hvcs\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.381988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.381956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-config\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.382339 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.382051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977625e7-860e-4c7c-983e-c363dec5329a-tmp\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.382950 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.382451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.384833 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.384815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977625e7-860e-4c7c-983e-c363dec5329a-serving-cert\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.385220 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.385197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-serving-cert\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.385305 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.385266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.385305 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.385286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.398069 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.398049    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8wg\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.399852 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.399832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7xg\" (UniqueName: \"kubernetes.io/projected/295d0dbb-aaf0-4180-b016-3c969365f556-kube-api-access-2x7xg\") pod \"volume-data-source-validator-78cf4c6f6-k9ct9\" (UID: \"295d0dbb-aaf0-4180-b016-3c969365f556\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"
Jul 23 18:07:05.422233 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.422209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2htqc\" (UniqueName: \"kubernetes.io/projected/977625e7-860e-4c7c-983e-c363dec5329a-kube-api-access-2htqc\") pod \"insights-operator-555d9d7885-tgspg\" (UID: \"977625e7-860e-4c7c-983e-c363dec5329a\") " pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.422414 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.422391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7b4\" (UniqueName: \"kubernetes.io/projected/d32b6713-12a0-47d6-9104-312f00de8047-kube-api-access-6k7b4\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.422661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.422612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx4lx\" (UniqueName: \"kubernetes.io/projected/21c2b6a0-7479-4aa8-b71c-b9afb187d6d3-kube-api-access-bx4lx\") pod \"console-operator-565b7b569d-54cdl\" (UID: \"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3\") " pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.423187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.423168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.467459 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.467437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"
Jul 23 18:07:05.482152 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.482254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.482254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.482352 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fad7513-c439-4c95-9d24-bb3a24a04bcc-config\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.482352 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhhnm\" (UniqueName: \"kubernetes.io/projected/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-kube-api-access-rhhnm\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.482352 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p24v5\" (UniqueName: \"kubernetes.io/projected/5abd4122-6989-4780-bb88-cc36a881b421-kube-api-access-p24v5\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482272    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482389    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.982371576 +0000 UTC m=+35.711804072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482461    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.982440832 +0000 UTC m=+35.711873329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482315    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:05.482496 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482492    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5abd4122-6989-4780-bb88-cc36a881b421-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482527    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.9825149 +0000 UTC m=+35.711947396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.482552    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.982542864 +0000 UTC m=+35.711975361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-cert\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg85m\" (UniqueName: \"kubernetes.io/projected/7fad7513-c439-4c95-9d24-bb3a24a04bcc-kube-api-access-zg85m\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnm9v\" (UniqueName: \"kubernetes.io/projected/16b9be93-3d12-4ebf-b3ec-2b303a535466-kube-api-access-fnm9v\") pod \"network-check-source-7bc5b6bf85-j9z5n\" (UID: \"16b9be93-3d12-4ebf-b3ec-2b303a535466\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-default-certificate\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fad7513-c439-4c95-9d24-bb3a24a04bcc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e77422b-8dbe-4341-b061-b0bd8c933c2a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7fj\" (UniqueName: \"kubernetes.io/projected/b983cccf-bb1c-431a-ab76-0a89e6ea9367-kube-api-access-sz7fj\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-config-volume\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-tmp-dir\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.482821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-stats-auth\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edb5cc0d-a911-4603-a27b-ae9041cdac85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edb5cc0d-a911-4603-a27b-ae9041cdac85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqrck\" (UniqueName: \"kubernetes.io/projected/edb5cc0d-a911-4603-a27b-ae9041cdac85-kube-api-access-rqrck\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hvcs\" (UniqueName: \"kubernetes.io/projected/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-kube-api-access-5hvcs\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.482974    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fad7513-c439-4c95-9d24-bb3a24a04bcc-config\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.483575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.483240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5abd4122-6989-4780-bb88-cc36a881b421-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.483936 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.483681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-config-volume\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.483936 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.483819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-tmp-dir\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.483936 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.483857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edb5cc0d-a911-4603-a27b-ae9041cdac85-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.484144 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.484126    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:05.484205 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.484192    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:05.984177471 +0000 UTC m=+35.713609968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:05.484419 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.484392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3e77422b-8dbe-4341-b061-b0bd8c933c2a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:05.485423 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.485407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-cert\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.485886 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.485862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fad7513-c439-4c95-9d24-bb3a24a04bcc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.486064 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.486042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edb5cc0d-a911-4603-a27b-ae9041cdac85-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.486846 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.486823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-default-certificate\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.487765 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.487747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-stats-auth\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.501470 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.501452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:05.516020 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.515996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tgspg"
Jul 23 18:07:05.518542 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.518518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnm9v\" (UniqueName: \"kubernetes.io/projected/16b9be93-3d12-4ebf-b3ec-2b303a535466-kube-api-access-fnm9v\") pod \"network-check-source-7bc5b6bf85-j9z5n\" (UID: \"16b9be93-3d12-4ebf-b3ec-2b303a535466\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"
Jul 23 18:07:05.518963 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.518939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hvcs\" (UniqueName: \"kubernetes.io/projected/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-kube-api-access-5hvcs\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:05.519049 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.518975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p24v5\" (UniqueName: \"kubernetes.io/projected/5abd4122-6989-4780-bb88-cc36a881b421-kube-api-access-p24v5\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:05.519843 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.519799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqrck\" (UniqueName: \"kubernetes.io/projected/edb5cc0d-a911-4603-a27b-ae9041cdac85-kube-api-access-rqrck\") pod \"kube-storage-version-migrator-operator-7658d9b749-z7vmp\" (UID: \"edb5cc0d-a911-4603-a27b-ae9041cdac85\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.520510 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.520479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg85m\" (UniqueName: \"kubernetes.io/projected/7fad7513-c439-4c95-9d24-bb3a24a04bcc-kube-api-access-zg85m\") pod \"service-ca-operator-5bcbc94c78-r987s\" (UID: \"7fad7513-c439-4c95-9d24-bb3a24a04bcc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.521577 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.521561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhhnm\" (UniqueName: \"kubernetes.io/projected/0f5e0924-1df0-421b-99ee-e1c23b8eacd2-kube-api-access-rhhnm\") pod \"ingress-canary-999l7\" (UID: \"0f5e0924-1df0-421b-99ee-e1c23b8eacd2\") " pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.527571 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.527553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz7fj\" (UniqueName: \"kubernetes.io/projected/b983cccf-bb1c-431a-ab76-0a89e6ea9367-kube-api-access-sz7fj\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:05.555655 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.555622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"
Jul 23 18:07:05.564697 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.564677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"
Jul 23 18:07:05.581698 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.581506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"
Jul 23 18:07:05.595839 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.595813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-999l7"
Jul 23 18:07:05.776133 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.771875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9"]
Jul 23 18:07:05.776133 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.773600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tgspg"]
Jul 23 18:07:05.777967 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.777842    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295d0dbb_aaf0_4180_b016_3c969365f556.slice/crio-a72280b958d93096947b1ce17d6ba1b1a182495f1e23d8b9a6a2c4659acb56b4 WatchSource:0}: Error finding container a72280b958d93096947b1ce17d6ba1b1a182495f1e23d8b9a6a2c4659acb56b4: Status 404 returned error can't find the container with id a72280b958d93096947b1ce17d6ba1b1a182495f1e23d8b9a6a2c4659acb56b4
Jul 23 18:07:05.780890 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.780615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-54cdl"]
Jul 23 18:07:05.784413 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.784331    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977625e7_860e_4c7c_983e_c363dec5329a.slice/crio-03245f8583adf266562ee4700d7221ba53f5743173cf4a2c7ea513f13285a454 WatchSource:0}: Error finding container 03245f8583adf266562ee4700d7221ba53f5743173cf4a2c7ea513f13285a454: Status 404 returned error can't find the container with id 03245f8583adf266562ee4700d7221ba53f5743173cf4a2c7ea513f13285a454
Jul 23 18:07:05.785958 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.785921    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c2b6a0_7479_4aa8_b71c_b9afb187d6d3.slice/crio-837547f977922641386182c9393a7620e015a12f7558e603ca67aef889afb652 WatchSource:0}: Error finding container 837547f977922641386182c9393a7620e015a12f7558e603ca67aef889afb652: Status 404 returned error can't find the container with id 837547f977922641386182c9393a7620e015a12f7558e603ca67aef889afb652
Jul 23 18:07:05.833639 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.833610    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s"]
Jul 23 18:07:05.835031 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.835003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp"]
Jul 23 18:07:05.838866 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.838835    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fad7513_c439_4c95_9d24_bb3a24a04bcc.slice/crio-36e6bbc6470ea159e5dbf603e4499ccc33e560e7c7e0fce51426179b84cf86fb WatchSource:0}: Error finding container 36e6bbc6470ea159e5dbf603e4499ccc33e560e7c7e0fce51426179b84cf86fb: Status 404 returned error can't find the container with id 36e6bbc6470ea159e5dbf603e4499ccc33e560e7c7e0fce51426179b84cf86fb
Jul 23 18:07:05.839868 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.839756    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb5cc0d_a911_4603_a27b_ae9041cdac85.slice/crio-01b8eab6b819ea2a49ea822ceba08a61fbb1077b7bd82bec01c4316ec4b6582f WatchSource:0}: Error finding container 01b8eab6b819ea2a49ea822ceba08a61fbb1077b7bd82bec01c4316ec4b6582f: Status 404 returned error can't find the container with id 01b8eab6b819ea2a49ea822ceba08a61fbb1077b7bd82bec01c4316ec4b6582f
Jul 23 18:07:05.885466 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.885439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n"]
Jul 23 18:07:05.886648 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.886627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-999l7"]
Jul 23 18:07:05.888196 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.888104    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5e0924_1df0_421b_99ee_e1c23b8eacd2.slice/crio-a2ee8bcb7ac80c65ac9dde3b35482e360141f07470f916ba23500b13b0935562 WatchSource:0}: Error finding container a2ee8bcb7ac80c65ac9dde3b35482e360141f07470f916ba23500b13b0935562: Status 404 returned error can't find the container with id a2ee8bcb7ac80c65ac9dde3b35482e360141f07470f916ba23500b13b0935562
Jul 23 18:07:05.888849 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:05.888823    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b9be93_3d12_4ebf_b3ec_2b303a535466.slice/crio-843bfec7747a3e7a095e15190409805cb2d305c4c97cf0f27f2da01584b091e5 WatchSource:0}: Error finding container 843bfec7747a3e7a095e15190409805cb2d305c4c97cf0f27f2da01584b091e5: Status 404 returned error can't find the container with id 843bfec7747a3e7a095e15190409805cb2d305c4c97cf0f27f2da01584b091e5
Jul 23 18:07:05.896499 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.896473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-999l7" event={"ID":"0f5e0924-1df0-421b-99ee-e1c23b8eacd2","Type":"ContainerStarted","Data":"a2ee8bcb7ac80c65ac9dde3b35482e360141f07470f916ba23500b13b0935562"}
Jul 23 18:07:05.897774 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.897746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s" event={"ID":"7fad7513-c439-4c95-9d24-bb3a24a04bcc","Type":"ContainerStarted","Data":"36e6bbc6470ea159e5dbf603e4499ccc33e560e7c7e0fce51426179b84cf86fb"}
Jul 23 18:07:05.898820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.898801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" event={"ID":"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3","Type":"ContainerStarted","Data":"837547f977922641386182c9393a7620e015a12f7558e603ca67aef889afb652"}
Jul 23 18:07:05.899818 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.899796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp" event={"ID":"edb5cc0d-a911-4603-a27b-ae9041cdac85","Type":"ContainerStarted","Data":"01b8eab6b819ea2a49ea822ceba08a61fbb1077b7bd82bec01c4316ec4b6582f"}
Jul 23 18:07:05.899906 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.899819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:05.899962 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.899933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:05.899962 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.899950    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:05.900041 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.899964    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:05.900041 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.900006    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:06.899991715 +0000 UTC m=+36.629424210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:05.900041 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.900033    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:05.900159 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:05.900092    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:06.900075143 +0000 UTC m=+36.629507641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:05.901107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.901055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n" event={"ID":"16b9be93-3d12-4ebf-b3ec-2b303a535466","Type":"ContainerStarted","Data":"843bfec7747a3e7a095e15190409805cb2d305c4c97cf0f27f2da01584b091e5"}
Jul 23 18:07:05.902178 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.902155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tgspg" event={"ID":"977625e7-860e-4c7c-983e-c363dec5329a","Type":"ContainerStarted","Data":"03245f8583adf266562ee4700d7221ba53f5743173cf4a2c7ea513f13285a454"}
Jul 23 18:07:05.903700 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:05.903679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9" event={"ID":"295d0dbb-aaf0-4180-b016-3c969365f556","Type":"ContainerStarted","Data":"a72280b958d93096947b1ce17d6ba1b1a182495f1e23d8b9a6a2c4659acb56b4"}
Jul 23 18:07:06.000633 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.000607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:06.000774 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.000641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:06.000774 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.000661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:06.000774 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.000726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:06.000774 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000747    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:06.000774 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000766    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.000802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000826    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.000812475 +0000 UTC m=+36.730244971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000845    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.00083856 +0000 UTC m=+36.730271056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000858    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000903    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.000885935 +0000 UTC m=+36.730318434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000925    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.000913224 +0000 UTC m=+36.730345724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000940    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:06.001053 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.000977    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:07.000962003 +0000 UTC m=+36.730394504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:06.742992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.742466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:06.742992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.742494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:06.742992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.742500    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:06.750850 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.750828    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:07:06.750977 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.750887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t929l\""
Jul 23 18:07:06.751293 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.751270    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbklj\""
Jul 23 18:07:06.754183 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.754166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:07:06.910512 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.910432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:06.910669 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:06.910569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:06.910809 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.910792    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:06.910875 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.910812    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:06.910875 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.910866    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:08.910847919 +0000 UTC m=+38.640280437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:06.911285 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.911267    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:06.911355 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:06.911323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:08.91130899 +0000 UTC m=+38.640741501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:07.011735 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:07.011702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:07.011928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:07.011770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:07.011928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:07.011824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:07.011928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:07.011851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:07.011928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:07.011920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:07.012130 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012075    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:07.012184 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012134    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.012116008 +0000 UTC m=+38.741548505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:07.012541 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012492    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:07.012704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012549    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.01253524 +0000 UTC m=+38.741967742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:07.012704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012605    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:07.012704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012633    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.012624144 +0000 UTC m=+38.742056641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:07.012704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012681    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:07.012963 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012712    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.012701235 +0000 UTC m=+38.742133737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:07.012963 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:07.012771    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.012762219 +0000 UTC m=+38.742194719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:08.932843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:08.932966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:08.933145    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:08.933160    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:08.933226    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:12.933206517 +0000 UTC m=+42.662639018 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:08.933620    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:08.933699 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:08.933669    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:12.933653164 +0000 UTC m=+42.663085674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:09.034175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:09.034251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:09.034286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:09.034312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034366    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:09.034384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034431    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.034410826 +0000 UTC m=+42.763843340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034471    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034502    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.034492813 +0000 UTC m=+42.763925323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034556    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034584    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.034575673 +0000 UTC m=+42.764008176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034633    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034660    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.034651675 +0000 UTC m=+42.764084186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:09.034829 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:09.034717    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:13.034708886 +0000 UTC m=+42.764141384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:12.971213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:12.971179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:12.971304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:12.971349    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:12.971366    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:12.971428    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:20.97141017 +0000 UTC m=+50.700842669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:12.971460    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:12.971704 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:12.971520    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:20.971506249 +0000 UTC m=+50.700938745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:13.071821 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:13.071762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:13.071989 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:13.071837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:13.071989 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:13.071911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:13.071989 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.071935    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:13.072107 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072005    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.071984528 +0000 UTC m=+50.801417028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:13.072107 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072029    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.072017828 +0000 UTC m=+50.801450327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:13.072107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:13.072056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:13.072108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072060    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072107    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072197    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.072159036 +0000 UTC m=+50.801591548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072201    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072251    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.072227536 +0000 UTC m=+50.801660046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:13.072273 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:13.072274    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.072262777 +0000 UTC m=+50.801695286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:16.944160 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.944127    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="cad524564e6751e26f2e2a2030cd998c03cc52718f6dea9eb3eaf7dbc0f00b0e" exitCode=0
Jul 23 18:07:16.944615 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.944219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"cad524564e6751e26f2e2a2030cd998c03cc52718f6dea9eb3eaf7dbc0f00b0e"}
Jul 23 18:07:16.947922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.947884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-999l7" event={"ID":"0f5e0924-1df0-421b-99ee-e1c23b8eacd2","Type":"ContainerStarted","Data":"213c0712eb7e586160a69fab1fea1de84f8987e45384628da6b5733f3cc31bd1"}
Jul 23 18:07:16.949457 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.949401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s" event={"ID":"7fad7513-c439-4c95-9d24-bb3a24a04bcc","Type":"ContainerStarted","Data":"19d65e8c1f4d2f7a7c85ebf7032434a6d3daffe898e41cf2aa94ff63d3b88d4a"}
Jul 23 18:07:16.952499 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.952475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/0.log"
Jul 23 18:07:16.952601 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.952516    2579 generic.go:356] "Generic (PLEG): container finished" podID="21c2b6a0-7479-4aa8-b71c-b9afb187d6d3" containerID="42c1ea5f13aeeb813c4e2bf6d6a9ba78b67f2f9e56feb689c8a33e5b7e196984" exitCode=255
Jul 23 18:07:16.952659 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.952601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" event={"ID":"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3","Type":"ContainerDied","Data":"42c1ea5f13aeeb813c4e2bf6d6a9ba78b67f2f9e56feb689c8a33e5b7e196984"}
Jul 23 18:07:16.952882 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.952863    2579 scope.go:117] "RemoveContainer" containerID="42c1ea5f13aeeb813c4e2bf6d6a9ba78b67f2f9e56feb689c8a33e5b7e196984"
Jul 23 18:07:16.954430 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.954403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp" event={"ID":"edb5cc0d-a911-4603-a27b-ae9041cdac85","Type":"ContainerStarted","Data":"5d30af050da19ac74c0c79f57c4c60e7c4ce8bfa5132db7405b1c78ae18ba8eb"}
Jul 23 18:07:16.956071 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.956051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n" event={"ID":"16b9be93-3d12-4ebf-b3ec-2b303a535466","Type":"ContainerStarted","Data":"a15129633276c02b72998bdcd4068fc544ded5bbf0e9b34f6be88ea706431cdb"}
Jul 23 18:07:16.957428 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.957406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tgspg" event={"ID":"977625e7-860e-4c7c-983e-c363dec5329a","Type":"ContainerStarted","Data":"9b63df1fc7e1026773d4e55a18267c9e1c8aac291ad024ffb6fb9a7b4b88523d"}
Jul 23 18:07:16.958846 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:16.958827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9" event={"ID":"295d0dbb-aaf0-4180-b016-3c969365f556","Type":"ContainerStarted","Data":"16562f07e7be4a496802ada8c4b776b6503342e5e54ecafd6f81098985fb45ad"}
Jul 23 18:07:17.116116 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.116034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s" podStartSLOduration=29.916147065 podStartE2EDuration="40.116012937s" totalImagesPullingTime="10.199865872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.043331206 +0000 UTC m=+46.772763727" watchObservedRunningTime="2026-07-23 18:07:17.116012937 +0000 UTC m=+46.845445453"
Jul 23 18:07:17.174932 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.174469    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-999l7" podStartSLOduration=2.029685649 podStartE2EDuration="12.174447012s" totalImagesPullingTime="10.144761363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.115541053 +0000 UTC m=+46.844973574" watchObservedRunningTime="2026-07-23 18:07:17.174447012 +0000 UTC m=+46.903879531"
Jul 23 18:07:17.211882 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.211830    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp" podStartSLOduration=30.019137669 podStartE2EDuration="40.21181075s" totalImagesPullingTime="10.192673081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.207802533 +0000 UTC m=+46.937235048" watchObservedRunningTime="2026-07-23 18:07:17.21181075 +0000 UTC m=+46.941243269"
Jul 23 18:07:17.218000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.213301    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k9ct9" podStartSLOduration=30.045682121 podStartE2EDuration="40.21328409s" totalImagesPullingTime="10.167601969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.17455875 +0000 UTC m=+46.903991272" watchObservedRunningTime="2026-07-23 18:07:17.21328409 +0000 UTC m=+46.942716607"
Jul 23 18:07:17.267983 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.267939    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-j9z5n" podStartSLOduration=26.123852335 podStartE2EDuration="36.267923071s" totalImagesPullingTime="10.144070736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.267151355 +0000 UTC m=+46.996583875" watchObservedRunningTime="2026-07-23 18:07:17.267923071 +0000 UTC m=+46.997355589"
Jul 23 18:07:17.395238 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.395154    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-tgspg" podStartSLOduration=30.14817641 podStartE2EDuration="40.395130064s" totalImagesPullingTime="10.246953654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:17.359242709 +0000 UTC m=+47.088675230" watchObservedRunningTime="2026-07-23 18:07:17.395130064 +0000 UTC m=+47.124562585"
Jul 23 18:07:17.397052 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.397023    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dd29m"]
Jul 23 18:07:17.417051 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.417029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.420001 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.419976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxc9z\" (UniqueName: \"kubernetes.io/projected/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-api-access-wxc9z\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.420132 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.420044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47869ec2-cde4-4899-ae3c-4c459f0f966e-crio-socket\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.420132 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.420083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.420224 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.420181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47869ec2-cde4-4899-ae3c-4c459f0f966e-data-volume\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.420224 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.420210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.422040 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.422015    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 18:07:17.424589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.424575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j5mk2\""
Jul 23 18:07:17.426625 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.426610    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 18:07:17.433960 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.433907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd29m"]
Jul 23 18:07:17.520991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.520911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47869ec2-cde4-4899-ae3c-4c459f0f966e-data-volume\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.520991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.520946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.521206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.521016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxc9z\" (UniqueName: \"kubernetes.io/projected/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-api-access-wxc9z\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.521206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.521086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47869ec2-cde4-4899-ae3c-4c459f0f966e-crio-socket\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.521206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.521134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.521206 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:17.521140    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:17.521384 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:17.521217    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:18.021197789 +0000 UTC m=+47.750630291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:17.521384 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.521244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47869ec2-cde4-4899-ae3c-4c459f0f966e-data-volume\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.521384 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:17.521256    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:07:17.521384 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:17.521307    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:18.021290849 +0000 UTC m=+47.750723348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : configmap "kube-rbac-proxy" not found
Jul 23 18:07:17.521384 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.521325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47869ec2-cde4-4899-ae3c-4c459f0f966e-crio-socket\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.543953 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.543926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxc9z\" (UniqueName: \"kubernetes.io/projected/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-api-access-wxc9z\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:17.966661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.966626    2579 generic.go:356] "Generic (PLEG): container finished" podID="184befdb-289c-447e-b8c6-2ceece197b4b" containerID="3c703d37ef8d20680d89391b05a1df21399edd0ab781b0240a4dc90573b7349a" exitCode=0
Jul 23 18:07:17.967081 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.966703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerDied","Data":"3c703d37ef8d20680d89391b05a1df21399edd0ab781b0240a4dc90573b7349a"}
Jul 23 18:07:17.968232 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.968216    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:07:17.968592 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.968579    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/0.log"
Jul 23 18:07:17.968654 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.968608    2579 generic.go:356] "Generic (PLEG): container finished" podID="21c2b6a0-7479-4aa8-b71c-b9afb187d6d3" containerID="40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00" exitCode=255
Jul 23 18:07:17.968729 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.968709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" event={"ID":"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3","Type":"ContainerDied","Data":"40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00"}
Jul 23 18:07:17.978578 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.978559    2579 scope.go:117] "RemoveContainer" containerID="42c1ea5f13aeeb813c4e2bf6d6a9ba78b67f2f9e56feb689c8a33e5b7e196984"
Jul 23 18:07:17.978675 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:17.978658    2579 scope.go:117] "RemoveContainer" containerID="40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00"
Jul 23 18:07:17.978842 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:17.978822    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-54cdl_openshift-console-operator(21c2b6a0-7479-4aa8-b71c-b9afb187d6d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" podUID="21c2b6a0-7479-4aa8-b71c-b9afb187d6d3"
Jul 23 18:07:18.025174 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:18.025139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:18.025327 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:18.025304    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:07:18.025435 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:18.025368    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:19.025346973 +0000 UTC m=+48.754779472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : configmap "kube-rbac-proxy" not found
Jul 23 18:07:18.025576 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:18.025553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:18.026276 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:18.026254    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:18.026361 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:18.026320    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:19.026301801 +0000 UTC m=+48.755734302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:18.975771 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:18.975740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" event={"ID":"184befdb-289c-447e-b8c6-2ceece197b4b","Type":"ContainerStarted","Data":"c84cc0fddf86e8ec23a42ec53b5270d2d63790c4a863053c2e1272d2c3e58791"}
Jul 23 18:07:18.979159 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:18.979133    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:07:18.979584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:18.979566    2579 scope.go:117] "RemoveContainer" containerID="40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00"
Jul 23 18:07:18.979824 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:18.979802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-54cdl_openshift-console-operator(21c2b6a0-7479-4aa8-b71c-b9afb187d6d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" podUID="21c2b6a0-7479-4aa8-b71c-b9afb187d6d3"
Jul 23 18:07:19.035004 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:19.034974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:19.035132 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:19.035108    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:19.035195 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:19.035153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:19.035195 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:19.035168    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.035149779 +0000 UTC m=+50.764582278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:19.035312 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:19.035199    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:07:19.035312 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:19.035234    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:21.035222528 +0000 UTC m=+50.764655038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : configmap "kube-rbac-proxy" not found
Jul 23 18:07:19.087476 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:19.087428    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkdjz" podStartSLOduration=13.422205915 podStartE2EDuration="49.08741626s" totalImagesPullingTime="35.665210345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:19.031763106 +0000 UTC m=+48.761195627" watchObservedRunningTime="2026-07-23 18:07:19.08741626 +0000 UTC m=+48.816848778"
Jul 23 18:07:19.640499 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:19.640471    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvcxt_f44b0cd6-0e92-4aa2-b099-17084090001a/dns-node-resolver/0.log"
Jul 23 18:07:20.235957 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:20.235931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c8js9_a4bb8a44-9c96-4570-bb4d-8824ef5607c9/node-ca/0.log"
Jul 23 18:07:21.032589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.032560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-999l7_0f5e0924-1df0-421b-99ee-e1c23b8eacd2/serve-healthcheck-canary/0.log"
Jul 23 18:07:21.051924 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.051895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:21.052017 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.051930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:21.052017 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.051996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:21.052017 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.052014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052038    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052100    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052106    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:25.052090399 +0000 UTC m=+54.781522895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052138    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052152    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls podName:d32b6713-12a0-47d6-9104-312f00de8047 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.052140527 +0000 UTC m=+66.781573023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwhbv" (UID: "d32b6713-12a0-47d6-9104-312f00de8047") : secret "samples-operator-tls" not found
Jul 23 18:07:21.052158 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052154    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5449bdf756-8dppk: secret "image-registry-tls" not found
Jul 23 18:07:21.052383 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.052206    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls podName:6c135a41-c6df-48d1-a123-e2f9679ce278 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.052189808 +0000 UTC m=+66.781622308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls") pod "image-registry-5449bdf756-8dppk" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278") : secret "image-registry-tls" not found
Jul 23 18:07:21.052476 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.052460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47869ec2-cde4-4899-ae3c-4c459f0f966e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:21.153244 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.153215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:21.153334 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.153259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:21.153334 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.153278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:21.153334 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153292    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:07:21.153334 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.153325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:21.153334 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153336    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.153324836 +0000 UTC m=+66.882757332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : secret "router-metrics-certs-default" not found
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153386    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153388    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153427    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls podName:4a7e4e8b-5e68-4b25-9211-c7948d9d7e18 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.153415116 +0000 UTC m=+66.882847614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls") pod "dns-default-6tg5l" (UID: "4a7e4e8b-5e68-4b25-9211-c7948d9d7e18") : secret "dns-default-metrics-tls" not found
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153439    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle podName:b983cccf-bb1c-431a-ab76-0a89e6ea9367 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.153433609 +0000 UTC m=+66.882866105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle") pod "router-default-78f5bc49b8-tr9lr" (UID: "b983cccf-bb1c-431a-ab76-0a89e6ea9367") : configmap references non-existent config key: service-ca.crt
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:21.153451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153502    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls podName:5abd4122-6989-4780-bb88-cc36a881b421 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.153492544 +0000 UTC m=+66.882925039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-spqxk" (UID: "5abd4122-6989-4780-bb88-cc36a881b421") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:07:21.153542 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153534    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 18:07:21.153770 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:21.153569    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert podName:3e77422b-8dbe-4341-b061-b0bd8c933c2a nodeName:}" failed. No retries permitted until 2026-07-23 18:07:37.153561192 +0000 UTC m=+66.882993687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-k6g2k" (UID: "3e77422b-8dbe-4341-b061-b0bd8c933c2a") : secret "networking-console-plugin-cert" not found
Jul 23 18:07:25.086275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:25.086237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:25.086830 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:25.086384    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:25.086830 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:25.086458    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls podName:47869ec2-cde4-4899-ae3c-4c459f0f966e nodeName:}" failed. No retries permitted until 2026-07-23 18:07:33.086443171 +0000 UTC m=+62.815875667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dd29m" (UID: "47869ec2-cde4-4899-ae3c-4c459f0f966e") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:07:25.502476 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:25.502387    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:25.502476 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:25.502439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:25.502816 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:25.502803    2579 scope.go:117] "RemoveContainer" containerID="40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00"
Jul 23 18:07:25.502975 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:25.502955    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-54cdl_openshift-console-operator(21c2b6a0-7479-4aa8-b71c-b9afb187d6d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" podUID="21c2b6a0-7479-4aa8-b71c-b9afb187d6d3"
Jul 23 18:07:30.895846 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:30.895820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbr8b"
Jul 23 18:07:33.159968 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:33.159921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:33.162355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:33.162325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47869ec2-cde4-4899-ae3c-4c459f0f966e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dd29m\" (UID: \"47869ec2-cde4-4899-ae3c-4c459f0f966e\") " pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:33.330707 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:33.330672    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j5mk2\""
Jul 23 18:07:33.338033 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:33.338009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dd29m"
Jul 23 18:07:33.474805 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:33.474757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dd29m"]
Jul 23 18:07:33.477670 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:33.477644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47869ec2_cde4_4899_ae3c_4c459f0f966e.slice/crio-87b3549086df764bd7d9684560cb4ebf0dcf4eb06a5303c21cf2b5ca9bd3d1fa WatchSource:0}: Error finding container 87b3549086df764bd7d9684560cb4ebf0dcf4eb06a5303c21cf2b5ca9bd3d1fa: Status 404 returned error can't find the container with id 87b3549086df764bd7d9684560cb4ebf0dcf4eb06a5303c21cf2b5ca9bd3d1fa
Jul 23 18:07:34.034564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:34.034521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd29m" event={"ID":"47869ec2-cde4-4899-ae3c-4c459f0f966e","Type":"ContainerStarted","Data":"87b3549086df764bd7d9684560cb4ebf0dcf4eb06a5303c21cf2b5ca9bd3d1fa"}
Jul 23 18:07:35.479708 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.479671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:35.480179 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.479773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:35.480179 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.479867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:35.482722 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.482696    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:07:35.482844 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.482809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mq5r\" (UniqueName: \"kubernetes.io/projected/7f30513c-94bd-4303-8af3-bfdd37a57583-kube-api-access-4mq5r\") pod \"network-check-target-hmd4g\" (UID: \"7f30513c-94bd-4303-8af3-bfdd37a57583\") " pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:35.483520 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.483494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:07:35.493052 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.493027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3daaab7-d095-49df-bb42-684d6f408100-metrics-certs\") pod \"network-metrics-daemon-dcmvx\" (UID: \"c3daaab7-d095-49df-bb42-684d6f408100\") " pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:35.493172 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.493122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e709b8e-9dbd-4254-bb8d-b31c4e3592a8-original-pull-secret\") pod \"global-pull-secret-syncer-qv8nx\" (UID: \"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8\") " pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:35.559836 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.559807    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbklj\""
Jul 23 18:07:35.567181 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.567154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:35.568185 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.568171    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t929l\""
Jul 23 18:07:35.571296 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.571278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qv8nx"
Jul 23 18:07:35.574960 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:35.574943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dcmvx"
Jul 23 18:07:37.095311 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.095274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:37.095810 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.095354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:37.097984 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.097957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d32b6713-12a0-47d6-9104-312f00de8047-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwhbv\" (UID: \"d32b6713-12a0-47d6-9104-312f00de8047\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:37.098106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.098061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"image-registry-5449bdf756-8dppk\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") " pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:37.196424 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.196387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:37.196582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.196435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:37.196582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.196487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:37.196582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.196520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:37.196582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.196576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:37.197415 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.197381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b983cccf-bb1c-431a-ab76-0a89e6ea9367-service-ca-bundle\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:37.199456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.199425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e77422b-8dbe-4341-b061-b0bd8c933c2a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-k6g2k\" (UID: \"3e77422b-8dbe-4341-b061-b0bd8c933c2a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:37.199456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.199445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b983cccf-bb1c-431a-ab76-0a89e6ea9367-metrics-certs\") pod \"router-default-78f5bc49b8-tr9lr\" (UID: \"b983cccf-bb1c-431a-ab76-0a89e6ea9367\") " pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:37.199583 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.199455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a7e4e8b-5e68-4b25-9211-c7948d9d7e18-metrics-tls\") pod \"dns-default-6tg5l\" (UID: \"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18\") " pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:37.200158 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.200138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5abd4122-6989-4780-bb88-cc36a881b421-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-spqxk\" (UID: \"5abd4122-6989-4780-bb88-cc36a881b421\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:37.262436 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.262405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c6cqn\""
Jul 23 18:07:37.270717 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.270661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:37.308574 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.308547    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztzjf\""
Jul 23 18:07:37.316205 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.316180    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"
Jul 23 18:07:37.333341 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.333321    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljrpj\""
Jul 23 18:07:37.341572 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.341552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"
Jul 23 18:07:37.351682 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.351665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7qsmn\""
Jul 23 18:07:37.358792 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.358758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:37.378706 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.378686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfp27\""
Jul 23 18:07:37.383736 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.383706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:37.407710 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.407694    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wr6v5\""
Jul 23 18:07:37.412506 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.412487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"
Jul 23 18:07:37.741835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:37.741756    2579 scope.go:117] "RemoveContainer" containerID="40bac7fe62baaa72a9a877de86b97f13819311ea8cb6b1b5adcda64a8dfbab00"
Jul 23 18:07:38.485454 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.479666    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e77422b_8dbe_4341_b061_b0bd8c933c2a.slice/crio-d6b2bfaf2f2603aaa366060cd27cc5b4f04e92ffdc674cb2b1fd0d6cb22ad92a WatchSource:0}: Error finding container d6b2bfaf2f2603aaa366060cd27cc5b4f04e92ffdc674cb2b1fd0d6cb22ad92a: Status 404 returned error can't find the container with id d6b2bfaf2f2603aaa366060cd27cc5b4f04e92ffdc674cb2b1fd0d6cb22ad92a
Jul 23 18:07:38.485454 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.482584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k"]
Jul 23 18:07:38.507942 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.507908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qv8nx"]
Jul 23 18:07:38.513806 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.513644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e709b8e_9dbd_4254_bb8d_b31c4e3592a8.slice/crio-79bded624a25b191702765e0dea0b4a759b143fc810d977a2a4df526d734dbff WatchSource:0}: Error finding container 79bded624a25b191702765e0dea0b4a759b143fc810d977a2a4df526d734dbff: Status 404 returned error can't find the container with id 79bded624a25b191702765e0dea0b4a759b143fc810d977a2a4df526d734dbff
Jul 23 18:07:38.739704 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.739488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk"]
Jul 23 18:07:38.742925 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.742895    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb983cccf_bb1c_431a_ab76_0a89e6ea9367.slice/crio-1523104b7ce9fee4c4d30c0351201de9d0919e6adba4bca84c6261c5126f8f42 WatchSource:0}: Error finding container 1523104b7ce9fee4c4d30c0351201de9d0919e6adba4bca84c6261c5126f8f42: Status 404 returned error can't find the container with id 1523104b7ce9fee4c4d30c0351201de9d0919e6adba4bca84c6261c5126f8f42
Jul 23 18:07:38.743567 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.743544    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abd4122_6989_4780_bb88_cc36a881b421.slice/crio-c3276ad1bcdb04792426eb5c6f0dcef570899bdc486d7f6c6b03875d8c95e6bf WatchSource:0}: Error finding container c3276ad1bcdb04792426eb5c6f0dcef570899bdc486d7f6c6b03875d8c95e6bf: Status 404 returned error can't find the container with id c3276ad1bcdb04792426eb5c6f0dcef570899bdc486d7f6c6b03875d8c95e6bf
Jul 23 18:07:38.745313 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.745251    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3daaab7_d095_49df_bb42_684d6f408100.slice/crio-b033f871d26f06e1620e897c9337acf89c4d0ef91798eec414ae1e93f5241e4c WatchSource:0}: Error finding container b033f871d26f06e1620e897c9337acf89c4d0ef91798eec414ae1e93f5241e4c: Status 404 returned error can't find the container with id b033f871d26f06e1620e897c9337acf89c4d0ef91798eec414ae1e93f5241e4c
Jul 23 18:07:38.746564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.746542    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78f5bc49b8-tr9lr"]
Jul 23 18:07:38.746644 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.746593    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dcmvx"]
Jul 23 18:07:38.779588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.779562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmd4g"]
Jul 23 18:07:38.781755 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.781715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv"]
Jul 23 18:07:38.819710 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.819682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:07:38.824297 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:38.824272    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6tg5l"]
Jul 23 18:07:38.824593 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.824571    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c135a41_c6df_48d1_a123_e2f9679ce278.slice/crio-e3bad61b10cfd6edcad39c2f4d65d18fcc816423a63f47042a76c55211d9e06c WatchSource:0}: Error finding container e3bad61b10cfd6edcad39c2f4d65d18fcc816423a63f47042a76c55211d9e06c: Status 404 returned error can't find the container with id e3bad61b10cfd6edcad39c2f4d65d18fcc816423a63f47042a76c55211d9e06c
Jul 23 18:07:38.828701 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:38.828531    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7e4e8b_5e68_4b25_9211_c7948d9d7e18.slice/crio-dd632f065538622b9b863340cf2e91aa9e5419298066eef3864137e3ddc66822 WatchSource:0}: Error finding container dd632f065538622b9b863340cf2e91aa9e5419298066eef3864137e3ddc66822: Status 404 returned error can't find the container with id dd632f065538622b9b863340cf2e91aa9e5419298066eef3864137e3ddc66822
Jul 23 18:07:39.054261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.054229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dcmvx" event={"ID":"c3daaab7-d095-49df-bb42-684d6f408100","Type":"ContainerStarted","Data":"b033f871d26f06e1620e897c9337acf89c4d0ef91798eec414ae1e93f5241e4c"}
Jul 23 18:07:39.055633 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.055602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tg5l" event={"ID":"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18","Type":"ContainerStarted","Data":"dd632f065538622b9b863340cf2e91aa9e5419298066eef3864137e3ddc66822"}
Jul 23 18:07:39.058058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.058033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:07:39.058155 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.058138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" event={"ID":"21c2b6a0-7479-4aa8-b71c-b9afb187d6d3","Type":"ContainerStarted","Data":"a90e9302b29a0df00d989ec9718ec21dc65c39da450e5ce2801389c59f224d3e"}
Jul 23 18:07:39.058721 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.058645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:39.064523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.064170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd29m" event={"ID":"47869ec2-cde4-4899-ae3c-4c459f0f966e","Type":"ContainerStarted","Data":"927637d3df0a914406f605b8c60c108bea61841357e49072591860dca450e5e8"}
Jul 23 18:07:39.065295 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.065271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-54cdl"
Jul 23 18:07:39.066468 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.066448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk" event={"ID":"5abd4122-6989-4780-bb88-cc36a881b421","Type":"ContainerStarted","Data":"c3276ad1bcdb04792426eb5c6f0dcef570899bdc486d7f6c6b03875d8c95e6bf"}
Jul 23 18:07:39.069482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.068693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmd4g" event={"ID":"7f30513c-94bd-4303-8af3-bfdd37a57583","Type":"ContainerStarted","Data":"b5f962431d3f215f05b6d856dd5a6b93074f56eafa74eef548d9a03dc7cee9c7"}
Jul 23 18:07:39.069482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.068730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmd4g" event={"ID":"7f30513c-94bd-4303-8af3-bfdd37a57583","Type":"ContainerStarted","Data":"6ae01f0f9e6ff984a52795180caece887140de7ee67276151eda52c2437d8d0d"}
Jul 23 18:07:39.069482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.068756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:07:39.070596 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.070544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qv8nx" event={"ID":"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8","Type":"ContainerStarted","Data":"79bded624a25b191702765e0dea0b4a759b143fc810d977a2a4df526d734dbff"}
Jul 23 18:07:39.073883 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.073859    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr" event={"ID":"b983cccf-bb1c-431a-ab76-0a89e6ea9367","Type":"ContainerStarted","Data":"64cbd308afcf98a1fa622351867cba3bb6a94b710011de08e239ce913ebf92d2"}
Jul 23 18:07:39.073987 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.073902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr" event={"ID":"b983cccf-bb1c-431a-ab76-0a89e6ea9367","Type":"ContainerStarted","Data":"1523104b7ce9fee4c4d30c0351201de9d0919e6adba4bca84c6261c5126f8f42"}
Jul 23 18:07:39.086408 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.084721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv" event={"ID":"d32b6713-12a0-47d6-9104-312f00de8047","Type":"ContainerStarted","Data":"56c20d7e2c2f05357866ac902862e2c91a00fe4814e38f4b48f5b39b2c1b4cef"}
Jul 23 18:07:39.091685 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.091655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k" event={"ID":"3e77422b-8dbe-4341-b061-b0bd8c933c2a","Type":"ContainerStarted","Data":"d6b2bfaf2f2603aaa366060cd27cc5b4f04e92ffdc674cb2b1fd0d6cb22ad92a"}
Jul 23 18:07:39.096451 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.096123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" event={"ID":"6c135a41-c6df-48d1-a123-e2f9679ce278","Type":"ContainerStarted","Data":"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"}
Jul 23 18:07:39.096451 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.096165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" event={"ID":"6c135a41-c6df-48d1-a123-e2f9679ce278","Type":"ContainerStarted","Data":"e3bad61b10cfd6edcad39c2f4d65d18fcc816423a63f47042a76c55211d9e06c"}
Jul 23 18:07:39.096451 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.096408    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:07:39.107804 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.107524    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hmd4g" podStartSLOduration=69.107506532 podStartE2EDuration="1m9.107506532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.106931683 +0000 UTC m=+68.836364229" watchObservedRunningTime="2026-07-23 18:07:39.107506532 +0000 UTC m=+68.836939052"
Jul 23 18:07:39.107804 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.107763    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-54cdl" podStartSLOduration=51.861321658 podStartE2EDuration="1m2.107754771s" totalImagesPullingTime="10.246433113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.084160991 +0000 UTC m=+68.813593510" watchObservedRunningTime="2026-07-23 18:07:39.107754771 +0000 UTC m=+68.837187292"
Jul 23 18:07:39.168577 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.168500    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr" podStartSLOduration=62.168479215 podStartE2EDuration="1m2.168479215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.167420156 +0000 UTC m=+68.896852699" watchObservedRunningTime="2026-07-23 18:07:39.168479215 +0000 UTC m=+68.897911733"
Jul 23 18:07:39.192722 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.191711    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" podStartSLOduration=68.191690558 podStartE2EDuration="1m8.191690558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:39.190642404 +0000 UTC m=+68.920074937" watchObservedRunningTime="2026-07-23 18:07:39.191690558 +0000 UTC m=+68.921123078"
Jul 23 18:07:39.359389 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.359312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:39.362439 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:39.362240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:40.103533 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:40.103365    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:40.105656 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:40.105463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78f5bc49b8-tr9lr"
Jul 23 18:07:47.995848 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:47.995815    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"]
Jul 23 18:07:48.018544 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.018483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"]
Jul 23 18:07:48.018662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.018568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:48.021369 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.021351    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 18:07:48.021538 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.021523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z2z6p\""
Jul 23 18:07:48.093667 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.093634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb6538fc-b066-4d9b-84d2-176134f6575b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8npfp\" (UID: \"bb6538fc-b066-4d9b-84d2-176134f6575b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:48.142917 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.142883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dcmvx" event={"ID":"c3daaab7-d095-49df-bb42-684d6f408100","Type":"ContainerStarted","Data":"fd58f60c00230fc39e6423927c03977f3d98da7cfb808aa28ecb17476884c432"}
Jul 23 18:07:48.143055 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.142949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dcmvx" event={"ID":"c3daaab7-d095-49df-bb42-684d6f408100","Type":"ContainerStarted","Data":"276f78dc9da97b501fa9d54443f0d5010a907b7ed02bb51b691978c055af0214"}
Jul 23 18:07:48.147114 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.147094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tg5l" event={"ID":"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18","Type":"ContainerStarted","Data":"fba199f940964cf7ab99ab8d831f75fce4fb2a655583ca262826fe3ce680fbff"}
Jul 23 18:07:48.147204 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.147139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:48.147204 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.147155    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6tg5l" event={"ID":"4a7e4e8b-5e68-4b25-9211-c7948d9d7e18","Type":"ContainerStarted","Data":"75f672d44683f05854733f6d66ec4790c2ffa639cd9b045ccc5916309fc49065"}
Jul 23 18:07:48.149204 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.149177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd29m" event={"ID":"47869ec2-cde4-4899-ae3c-4c459f0f966e","Type":"ContainerStarted","Data":"7369d09048a5e86e24bf7f81913154ef54d29a4a556a1d7b499a701751859283"}
Jul 23 18:07:48.150486 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.150465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk" event={"ID":"5abd4122-6989-4780-bb88-cc36a881b421","Type":"ContainerStarted","Data":"57e2370b9fb4306f133346373d10f2d1cebf86515d9a5a4cc7bb3f64e7d164cd"}
Jul 23 18:07:48.151912 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.151887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qv8nx" event={"ID":"3e709b8e-9dbd-4254-bb8d-b31c4e3592a8","Type":"ContainerStarted","Data":"1f27a220d8870510332eb2c00e445fb4ce8362e78ed20fba5db0b0ef3ca08df5"}
Jul 23 18:07:48.153627 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.153606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv" event={"ID":"d32b6713-12a0-47d6-9104-312f00de8047","Type":"ContainerStarted","Data":"d3c1a4b528d5e276e08d07878f2333aead2f5e3460c351270eacbf9d25e3e923"}
Jul 23 18:07:48.153709 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.153642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv" event={"ID":"d32b6713-12a0-47d6-9104-312f00de8047","Type":"ContainerStarted","Data":"01fdfc2d74d79f7894667077c5e3ee20215853151da334d471f324dc04cb2051"}
Jul 23 18:07:48.154845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.154826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k" event={"ID":"3e77422b-8dbe-4341-b061-b0bd8c933c2a","Type":"ContainerStarted","Data":"c0f2ed7d487c0c49b8e824bdeedda0ed96afd7b093f0cc411e650cc7a3faad50"}
Jul 23 18:07:48.176337 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.176297    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dcmvx" podStartSLOduration=70.768135196 podStartE2EDuration="1m18.176285424s" totalImagesPullingTime="7.408150228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.175753311 +0000 UTC m=+77.905185829" watchObservedRunningTime="2026-07-23 18:07:48.176285424 +0000 UTC m=+77.905717958"
Jul 23 18:07:48.194330 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.194304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb6538fc-b066-4d9b-84d2-176134f6575b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8npfp\" (UID: \"bb6538fc-b066-4d9b-84d2-176134f6575b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:48.196348 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.196308    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6tg5l" podStartSLOduration=34.79876788 podStartE2EDuration="43.196296044s" totalImagesPullingTime="8.397528164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.195479947 +0000 UTC m=+77.924912466" watchObservedRunningTime="2026-07-23 18:07:48.196296044 +0000 UTC m=+77.925728561"
Jul 23 18:07:48.197085 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.197067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb6538fc-b066-4d9b-84d2-176134f6575b-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-8npfp\" (UID: \"bb6538fc-b066-4d9b-84d2-176134f6575b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:48.216591 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.216556    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-k6g2k" podStartSLOduration=46.545258882 podStartE2EDuration="54.21654526s" totalImagesPullingTime="7.671286378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.216161745 +0000 UTC m=+77.945594264" watchObservedRunningTime="2026-07-23 18:07:48.21654526 +0000 UTC m=+77.945977805"
Jul 23 18:07:48.240960 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.240910    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwhbv" podStartSLOduration=62.850697543 podStartE2EDuration="1m11.240896142s" totalImagesPullingTime="8.390198599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.239886167 +0000 UTC m=+77.969318685" watchObservedRunningTime="2026-07-23 18:07:48.240896142 +0000 UTC m=+77.970328661"
Jul 23 18:07:48.262130 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.262093    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-spqxk" podStartSLOduration=62.779714476 podStartE2EDuration="1m11.262079115s" totalImagesPullingTime="8.482364639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.261915016 +0000 UTC m=+77.991347530" watchObservedRunningTime="2026-07-23 18:07:48.262079115 +0000 UTC m=+77.991511632"
Jul 23 18:07:48.327047 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.327023    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:48.481411 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.481360    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qv8nx" podStartSLOduration=68.757602071 podStartE2EDuration="1m17.481343251s" totalImagesPullingTime="8.72374118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:48.287526434 +0000 UTC m=+78.016958952" watchObservedRunningTime="2026-07-23 18:07:48.481343251 +0000 UTC m=+78.210775769"
Jul 23 18:07:48.482355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:48.482337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"]
Jul 23 18:07:48.485198 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:48.485159    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6538fc_b066_4d9b_84d2_176134f6575b.slice/crio-aa7c1cbb9baab744e03e3e915dd1048a21a69cdc679f8f5325d6f2c7575a63a6 WatchSource:0}: Error finding container aa7c1cbb9baab744e03e3e915dd1048a21a69cdc679f8f5325d6f2c7575a63a6: Status 404 returned error can't find the container with id aa7c1cbb9baab744e03e3e915dd1048a21a69cdc679f8f5325d6f2c7575a63a6
Jul 23 18:07:49.160726 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:49.160690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp" event={"ID":"bb6538fc-b066-4d9b-84d2-176134f6575b","Type":"ContainerStarted","Data":"aa7c1cbb9baab744e03e3e915dd1048a21a69cdc679f8f5325d6f2c7575a63a6"}
Jul 23 18:07:52.175410 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.175376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dd29m" event={"ID":"47869ec2-cde4-4899-ae3c-4c459f0f966e","Type":"ContainerStarted","Data":"9fa03c1d13d1242ac447382e03e505f4a4a0ee0744506954e11ffc9e913fd6fd"}
Jul 23 18:07:52.176980 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.176959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp" event={"ID":"bb6538fc-b066-4d9b-84d2-176134f6575b","Type":"ContainerStarted","Data":"42fc85a4717710c55c2cc07a94655bb94d6ac699c2135d5010c2ebfa52d201ec"}
Jul 23 18:07:52.177162 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.177147    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:52.185695 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.185673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp"
Jul 23 18:07:52.202318 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.202277    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dd29m" podStartSLOduration=17.353505515 podStartE2EDuration="35.202264341s" totalImagesPullingTime="17.848758826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:07:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:52.201362991 +0000 UTC m=+81.930795509" watchObservedRunningTime="2026-07-23 18:07:52.202264341 +0000 UTC m=+81.931696858"
Jul 23 18:07:52.217665 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:52.217628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-8npfp" podStartSLOduration=2.051684868 podStartE2EDuration="5.217615616s" totalImagesPullingTime="3.165930748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:52.216963508 +0000 UTC m=+81.946396030" watchObservedRunningTime="2026-07-23 18:07:52.217615616 +0000 UTC m=+81.947048134"
Jul 23 18:07:53.075661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.075627    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"]
Jul 23 18:07:53.080213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.080196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.082717 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.082693    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 18:07:53.083548 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.083526    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 18:07:53.083733 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.083716    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 18:07:53.083733 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.083727    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lwrvg\""
Jul 23 18:07:53.093609 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.093589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"]
Jul 23 18:07:53.237002 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.236967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb140fe-e6f3-4668-8e70-10601dfd2be9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.237367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.237031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.237367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.237066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5874g\" (UniqueName: \"kubernetes.io/projected/7fb140fe-e6f3-4668-8e70-10601dfd2be9-kube-api-access-5874g\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.237367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.237094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.338040 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.337953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb140fe-e6f3-4668-8e70-10601dfd2be9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.338182 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.338155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.338386 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.338356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5874g\" (UniqueName: \"kubernetes.io/projected/7fb140fe-e6f3-4668-8e70-10601dfd2be9-kube-api-access-5874g\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.338541 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.338451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.338737 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.338715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fb140fe-e6f3-4668-8e70-10601dfd2be9-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.340713 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.340693    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.340854 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.340824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7fb140fe-e6f3-4668-8e70-10601dfd2be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.350111 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.350088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5874g\" (UniqueName: \"kubernetes.io/projected/7fb140fe-e6f3-4668-8e70-10601dfd2be9-kube-api-access-5874g\") pod \"prometheus-operator-5945b5cfd-z4srw\" (UID: \"7fb140fe-e6f3-4668-8e70-10601dfd2be9\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.389849 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.389823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"
Jul 23 18:07:53.518345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:53.518315    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-z4srw"]
Jul 23 18:07:53.521862 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:53.521839    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb140fe_e6f3_4668_8e70_10601dfd2be9.slice/crio-90176c4d23005e1e7b483fe3d7d48c138be90394088c4d282110066737d80457 WatchSource:0}: Error finding container 90176c4d23005e1e7b483fe3d7d48c138be90394088c4d282110066737d80457: Status 404 returned error can't find the container with id 90176c4d23005e1e7b483fe3d7d48c138be90394088c4d282110066737d80457
Jul 23 18:07:54.187326 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:54.187285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw" event={"ID":"7fb140fe-e6f3-4668-8e70-10601dfd2be9","Type":"ContainerStarted","Data":"90176c4d23005e1e7b483fe3d7d48c138be90394088c4d282110066737d80457"}
Jul 23 18:07:55.192478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:55.192385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw" event={"ID":"7fb140fe-e6f3-4668-8e70-10601dfd2be9","Type":"ContainerStarted","Data":"839f95308a64d2af3f504a3bd08c583de97fb9a7bbb9d649ae5f65138ab898fa"}
Jul 23 18:07:55.192478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:55.192442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw" event={"ID":"7fb140fe-e6f3-4668-8e70-10601dfd2be9","Type":"ContainerStarted","Data":"9824e09ad00fddb0045f42db17671262b3cc61026995f78a23fbc4b02688c3f3"}
Jul 23 18:07:55.212427 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:55.212212    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-z4srw" podStartSLOduration=0.868657088 podStartE2EDuration="2.212193213s" totalImagesPullingTime="1.343536125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:55.211264675 +0000 UTC m=+84.940697209" watchObservedRunningTime="2026-07-23 18:07:55.212193213 +0000 UTC m=+84.941625734"
Jul 23 18:07:57.496745 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.496712    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nx67v"]
Jul 23 18:07:57.500254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.500233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.502766 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.502743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 18:07:57.503158 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.503141    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q2glh\""
Jul 23 18:07:57.504048 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.504029    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 18:07:57.504048 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.504042    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 18:07:57.521910 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.521886    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n2dlk"]
Jul 23 18:07:57.525553 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.525536    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nx67v"]
Jul 23 18:07:57.525682 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.525635    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.527564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.527544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mjcbz\""
Jul 23 18:07:57.527719 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.527697    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 18:07:57.527849 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.527707    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 18:07:57.527849 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.527572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 18:07:57.673215 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-wtmp\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673381 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72rhn\" (UniqueName: \"kubernetes.io/projected/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-kube-api-access-72rhn\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673381 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.673381 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-sys\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673381 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef316692-872b-491b-87b3-103bdbe1d9a7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-textfile\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrw62\" (UniqueName: \"kubernetes.io/projected/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-api-access-xrw62\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-metrics-client-ca\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.673748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.673748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-root\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.673748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.673681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.774552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-sys\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef316692-872b-491b-87b3-103bdbe1d9a7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.774552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-sys\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-textfile\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:57.774650    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrw62\" (UniqueName: \"kubernetes.io/projected/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-api-access-xrw62\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:57.774712    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls podName:79420e4f-f2ac-4b2d-a72c-3cccb81b480d nodeName:}" failed. No retries permitted until 2026-07-23 18:07:58.274690264 +0000 UTC m=+88.004122764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls") pod "node-exporter-n2dlk" (UID: "79420e4f-f2ac-4b2d-a72c-3cccb81b480d") : secret "node-exporter-tls" not found
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-metrics-client-ca\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.774873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-root\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ef316692-872b-491b-87b3-103bdbe1d9a7-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.774958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-wtmp\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72rhn\" (UniqueName: \"kubernetes.io/projected/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-kube-api-access-72rhn\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-root\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-textfile\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.775516 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-wtmp\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.776037 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-metrics-client-ca\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.776037 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-accelerators-collector-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.776037 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.775701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.776326 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.776302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.777838 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.777812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.777946 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.777934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.778214 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.778192    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.789764 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.789742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrw62\" (UniqueName: \"kubernetes.io/projected/ef316692-872b-491b-87b3-103bdbe1d9a7-kube-api-access-xrw62\") pod \"kube-state-metrics-56c5594674-nx67v\" (UID: \"ef316692-872b-491b-87b3-103bdbe1d9a7\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.790174 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.790157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72rhn\" (UniqueName: \"kubernetes.io/projected/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-kube-api-access-72rhn\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:57.809094 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.809077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v"
Jul 23 18:07:57.958706 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:57.958676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-nx67v"]
Jul 23 18:07:57.962157 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:57.962132    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef316692_872b_491b_87b3_103bdbe1d9a7.slice/crio-d86bfc9e7da362d01089933c00d3c69581e0bc5e17f40fcfe4e31f5b0c4f9b5b WatchSource:0}: Error finding container d86bfc9e7da362d01089933c00d3c69581e0bc5e17f40fcfe4e31f5b0c4f9b5b: Status 404 returned error can't find the container with id d86bfc9e7da362d01089933c00d3c69581e0bc5e17f40fcfe4e31f5b0c4f9b5b
Jul 23 18:07:58.163392 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:58.163359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6tg5l"
Jul 23 18:07:58.207227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:58.207191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v" event={"ID":"ef316692-872b-491b-87b3-103bdbe1d9a7","Type":"ContainerStarted","Data":"d86bfc9e7da362d01089933c00d3c69581e0bc5e17f40fcfe4e31f5b0c4f9b5b"}
Jul 23 18:07:58.278770 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:58.278730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:58.278977 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:58.278883    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 18:07:58.278977 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:07:58.278954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls podName:79420e4f-f2ac-4b2d-a72c-3cccb81b480d nodeName:}" failed. No retries permitted until 2026-07-23 18:07:59.27893594 +0000 UTC m=+89.008368444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls") pod "node-exporter-n2dlk" (UID: "79420e4f-f2ac-4b2d-a72c-3cccb81b480d") : secret "node-exporter-tls" not found
Jul 23 18:07:59.289592 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:59.289563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:59.292001 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:59.291975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79420e4f-f2ac-4b2d-a72c-3cccb81b480d-node-exporter-tls\") pod \"node-exporter-n2dlk\" (UID: \"79420e4f-f2ac-4b2d-a72c-3cccb81b480d\") " pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:59.335134 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:07:59.335103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n2dlk"
Jul 23 18:07:59.346125 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:07:59.346105    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79420e4f_f2ac_4b2d_a72c_3cccb81b480d.slice/crio-f94bf3f6f7b6ad63368a31f1ff84802268ad7aba44edac96ec336dd73a255782 WatchSource:0}: Error finding container f94bf3f6f7b6ad63368a31f1ff84802268ad7aba44edac96ec336dd73a255782: Status 404 returned error can't find the container with id f94bf3f6f7b6ad63368a31f1ff84802268ad7aba44edac96ec336dd73a255782
Jul 23 18:08:00.108845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.108771    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:08:00.219805 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.219193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v" event={"ID":"ef316692-872b-491b-87b3-103bdbe1d9a7","Type":"ContainerStarted","Data":"bc2cec9649b9ecfbe382beeae8354c8cb3596ab892c728e75c292e0e782f8bb7"}
Jul 23 18:08:00.219805 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.219261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v" event={"ID":"ef316692-872b-491b-87b3-103bdbe1d9a7","Type":"ContainerStarted","Data":"d8a3f6530628233d3343cf98dc7dcffef8cd4e94b06e9975d4d9f96d02de8272"}
Jul 23 18:08:00.219805 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.219294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v" event={"ID":"ef316692-872b-491b-87b3-103bdbe1d9a7","Type":"ContainerStarted","Data":"4776fb9c04cecad223e29f1081a8059e2e30dbbedb54ae291d75322a7e816aa5"}
Jul 23 18:08:00.220724 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.220693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2dlk" event={"ID":"79420e4f-f2ac-4b2d-a72c-3cccb81b480d","Type":"ContainerStarted","Data":"f94bf3f6f7b6ad63368a31f1ff84802268ad7aba44edac96ec336dd73a255782"}
Jul 23 18:08:00.243806 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:00.243734    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-nx67v" podStartSLOduration=1.866999879 podStartE2EDuration="3.243716073s" totalImagesPullingTime="1.376716194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:00.242632458 +0000 UTC m=+89.972064975" watchObservedRunningTime="2026-07-23 18:08:00.243716073 +0000 UTC m=+89.973148592"
Jul 23 18:08:01.225832 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:01.225798    2579 generic.go:356] "Generic (PLEG): container finished" podID="79420e4f-f2ac-4b2d-a72c-3cccb81b480d" containerID="eec192c43fee406f3233be8632d7de545c01381b928f27430f955336c4dd872a" exitCode=0
Jul 23 18:08:01.226238 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:01.225881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2dlk" event={"ID":"79420e4f-f2ac-4b2d-a72c-3cccb81b480d","Type":"ContainerDied","Data":"eec192c43fee406f3233be8632d7de545c01381b928f27430f955336c4dd872a"}
Jul 23 18:08:02.232308 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.232270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2dlk" event={"ID":"79420e4f-f2ac-4b2d-a72c-3cccb81b480d","Type":"ContainerStarted","Data":"20ed4063f1369ec0b2b7d043de1a5760e334740024ca80f1f4cfd49c5c738534"}
Jul 23 18:08:02.232683 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.232369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n2dlk" event={"ID":"79420e4f-f2ac-4b2d-a72c-3cccb81b480d","Type":"ContainerStarted","Data":"c21f0ba86ebb99fd8240593c47dece22d51847901f80c763d830f73da5b2bfbc"}
Jul 23 18:08:02.258080 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.258027    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n2dlk" podStartSLOduration=4.137983899 podStartE2EDuration="5.258013439s" totalImagesPullingTime="1.046707692s" totalInitContainerRuntime="73.321848ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:02.256041322 +0000 UTC m=+91.985474036" watchObservedRunningTime="2026-07-23 18:08:02.258013439 +0000 UTC m=+91.987445961"
Jul 23 18:08:02.826536 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.826506    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"]
Jul 23 18:08:02.830274 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.830256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:02.844720 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.844644    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 18:08:02.844720 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.844650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 18:08:02.844720 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.844677    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 18:08:02.844720 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.844702    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rxpg5\""
Jul 23 18:08:02.845048 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.844766    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 18:08:02.849729 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.849663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 18:08:02.853603 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.853587    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 18:08:02.858568 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:02.858549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"]
Jul 23 18:08:03.020928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.020896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.020946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.020970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.021044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-federate-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.021083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-serving-certs-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021306 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.021114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-metrics-client-ca\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021306 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.021169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jp25\" (UniqueName: \"kubernetes.io/projected/0448fc5a-7017-4aeb-941f-38b763d3f9c3-kube-api-access-8jp25\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.021306 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.021219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122625 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jp25\" (UniqueName: \"kubernetes.io/projected/0448fc5a-7017-4aeb-941f-38b763d3f9c3-kube-api-access-8jp25\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122625 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122625 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-federate-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.122919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-serving-certs-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.123130 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.122959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-metrics-client-ca\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.123533 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.123507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-serving-certs-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.123643 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.123613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-metrics-client-ca\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.123991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.123969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.125484 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.125458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-federate-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.125597 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.125575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-telemeter-client-tls\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.125765 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.125750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.125873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.125850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0448fc5a-7017-4aeb-941f-38b763d3f9c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.137197 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.137178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jp25\" (UniqueName: \"kubernetes.io/projected/0448fc5a-7017-4aeb-941f-38b763d3f9c3-kube-api-access-8jp25\") pod \"telemeter-client-8489f4cf46-s8mfp\" (UID: \"0448fc5a-7017-4aeb-941f-38b763d3f9c3\") " pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.139022 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.139007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"
Jul 23 18:08:03.279963 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.279940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8489f4cf46-s8mfp"]
Jul 23 18:08:03.282021 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:08:03.281992    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0448fc5a_7017_4aeb_941f_38b763d3f9c3.slice/crio-ab7dc40cabe7af2b9feca7d64b866074e75898002e7c9f57246fcdb3e87447d9 WatchSource:0}: Error finding container ab7dc40cabe7af2b9feca7d64b866074e75898002e7c9f57246fcdb3e87447d9: Status 404 returned error can't find the container with id ab7dc40cabe7af2b9feca7d64b866074e75898002e7c9f57246fcdb3e87447d9
Jul 23 18:08:03.900656 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.900617    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:08:03.908998 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.908969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:03.912201 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.912168    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 18:08:03.912371 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.912348    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 18:08:03.913267 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.913224    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 18:08:03.913401 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.913382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 18:08:03.916261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.913916    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 18:08:03.916261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.913916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1tahfbc6lka6h\""
Jul 23 18:08:03.916261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.916230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 18:08:03.916996 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.916889    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 18:08:03.917190 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.917170    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 18:08:03.917409 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.917388    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 18:08:03.918095 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.917947    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 18:08:03.918601 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.918347    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j4bg7\""
Jul 23 18:08:03.918601 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.918407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 18:08:03.918601 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.918503    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 18:08:03.918899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.918881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 18:08:03.918971 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.918900    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 18:08:03.921696 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.921676    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 18:08:03.925066 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:03.925043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:08:04.031993 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.031958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.031993 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.031992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mtth\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-kube-api-access-7mtth\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032574 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032574 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032574 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.032574 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.032510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.132986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mtth\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-kube-api-access-7mtth\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.133662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.133593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.134621 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.134557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.134862 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.134802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.134988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.134892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.135324 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.135265    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.136748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.136155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.136748 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.136503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.136912 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.136840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.138360 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.138331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b452f24-037f-40a3-83b4-a89cd8ca08aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.138811 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.138508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.139857 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.139832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.141040 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.140971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.142254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.141713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.142254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.141937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.142254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.141996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.142254 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.142217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.143021 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.143000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.145163 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.143009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b452f24-037f-40a3-83b4-a89cd8ca08aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.145163 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.143501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.145163 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.143971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b452f24-037f-40a3-83b4-a89cd8ca08aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.154941 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.153932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mtth\" (UniqueName: \"kubernetes.io/projected/1b452f24-037f-40a3-83b4-a89cd8ca08aa-kube-api-access-7mtth\") pod \"prometheus-k8s-0\" (UID: \"1b452f24-037f-40a3-83b4-a89cd8ca08aa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.225009 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.224908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:04.247005 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.246976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp" event={"ID":"0448fc5a-7017-4aeb-941f-38b763d3f9c3","Type":"ContainerStarted","Data":"ab7dc40cabe7af2b9feca7d64b866074e75898002e7c9f57246fcdb3e87447d9"}
Jul 23 18:08:04.412020 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:04.411992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 18:08:04.413963 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:08:04.413931    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b452f24_037f_40a3_83b4_a89cd8ca08aa.slice/crio-42a862f8dfe7cc711ddd4d81610cbd0049d5b8db3f0a00c4af82e225019c08a8 WatchSource:0}: Error finding container 42a862f8dfe7cc711ddd4d81610cbd0049d5b8db3f0a00c4af82e225019c08a8: Status 404 returned error can't find the container with id 42a862f8dfe7cc711ddd4d81610cbd0049d5b8db3f0a00c4af82e225019c08a8
Jul 23 18:08:05.252398 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:05.252359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp" event={"ID":"0448fc5a-7017-4aeb-941f-38b763d3f9c3","Type":"ContainerStarted","Data":"c5e6876098836803f57caf81afb3f119c5740135c8f5c154c1ad317f4973fc3b"}
Jul 23 18:08:05.253520 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:05.253496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"42a862f8dfe7cc711ddd4d81610cbd0049d5b8db3f0a00c4af82e225019c08a8"}
Jul 23 18:08:06.259593 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:06.259505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp" event={"ID":"0448fc5a-7017-4aeb-941f-38b763d3f9c3","Type":"ContainerStarted","Data":"dbdabf0d8191e8236012f4dfcda1f7ac37279896312bf767574f3147fc51ff6d"}
Jul 23 18:08:06.259982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:06.259622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp" event={"ID":"0448fc5a-7017-4aeb-941f-38b763d3f9c3","Type":"ContainerStarted","Data":"0385b68c5ccb75217ceb565a8c18ec2db0ce5ebf1b9256bc908628236f5d67cf"}
Jul 23 18:08:06.261160 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:06.261134    2579 generic.go:356] "Generic (PLEG): container finished" podID="1b452f24-037f-40a3-83b4-a89cd8ca08aa" containerID="dbbdcc508d001fcbc5a58dbc5ec07fab88501c019468e9e75ecc0a99155f0188" exitCode=0
Jul 23 18:08:06.261276 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:06.261187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerDied","Data":"dbbdcc508d001fcbc5a58dbc5ec07fab88501c019468e9e75ecc0a99155f0188"}
Jul 23 18:08:06.284477 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:06.284437    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8489f4cf46-s8mfp" podStartSLOduration=1.702936041 podStartE2EDuration="4.284425248s" totalImagesPullingTime="2.581489207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:06.283375201 +0000 UTC m=+96.012807718" watchObservedRunningTime="2026-07-23 18:08:06.284425248 +0000 UTC m=+96.013857786"
Jul 23 18:08:08.668242 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:08.667795    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:08:10.106145 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:10.106113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hmd4g"
Jul 23 18:08:10.283093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:10.283060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"7a11c5f0f3292691dbe9bb1dc9ab630a157fa0b55ae919f5eb44595bf42b458a"}
Jul 23 18:08:10.283261 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:10.283127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"7d9c91d722a724360196fd6cae3a43ca7a1d9a29cbf729281a88df253074d118"}
Jul 23 18:08:12.295005 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:12.294969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"25ffe3b96d31b4070ed37ab541c1b7c252496c1d34a3a75e2df3d59750146adc"}
Jul 23 18:08:12.295462 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:12.295053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"9c3760008d275f115469852b4f32e9a66796f615f11f18056b7542fc06abf5dc"}
Jul 23 18:08:12.295462 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:12.295096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"16bc04950d9b29eedfabd822348824f411c1dca9fa6782d4ca4bc17e0ecd5249"}
Jul 23 18:08:12.295462 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:12.295144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b452f24-037f-40a3-83b4-a89cd8ca08aa","Type":"ContainerStarted","Data":"8be51c300fc10724b97acc8b5d658f47a7bf9a536924e2d4b72621b3aa2b1b61"}
Jul 23 18:08:12.334431 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:12.334375    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.686833868 podStartE2EDuration="9.334354637s" totalImagesPullingTime="6.624127958s" totalInitContainerRuntime="23.392811ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:12.331834661 +0000 UTC m=+102.061267182" watchObservedRunningTime="2026-07-23 18:08:12.334354637 +0000 UTC m=+102.063787156"
Jul 23 18:08:14.225158 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:14.225124    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:08:27.362651 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:27.362613    2579 generic.go:356] "Generic (PLEG): container finished" podID="977625e7-860e-4c7c-983e-c363dec5329a" containerID="9b63df1fc7e1026773d4e55a18267c9e1c8aac291ad024ffb6fb9a7b4b88523d" exitCode=0
Jul 23 18:08:27.363067 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:27.362679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tgspg" event={"ID":"977625e7-860e-4c7c-983e-c363dec5329a","Type":"ContainerDied","Data":"9b63df1fc7e1026773d4e55a18267c9e1c8aac291ad024ffb6fb9a7b4b88523d"}
Jul 23 18:08:27.363067 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:27.363060    2579 scope.go:117] "RemoveContainer" containerID="9b63df1fc7e1026773d4e55a18267c9e1c8aac291ad024ffb6fb9a7b4b88523d"
Jul 23 18:08:28.368156 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:28.368119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tgspg" event={"ID":"977625e7-860e-4c7c-983e-c363dec5329a","Type":"ContainerStarted","Data":"45661b78a9d07d451280301d680d48aafc3e88cbdbe3fe2df9b2aefa9e4d57d4"}
Jul 23 18:08:32.386705 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:32.386672    2579 generic.go:356] "Generic (PLEG): container finished" podID="edb5cc0d-a911-4603-a27b-ae9041cdac85" containerID="5d30af050da19ac74c0c79f57c4c60e7c4ce8bfa5132db7405b1c78ae18ba8eb" exitCode=0
Jul 23 18:08:32.387259 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:32.386744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp" event={"ID":"edb5cc0d-a911-4603-a27b-ae9041cdac85","Type":"ContainerDied","Data":"5d30af050da19ac74c0c79f57c4c60e7c4ce8bfa5132db7405b1c78ae18ba8eb"}
Jul 23 18:08:32.387259 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:32.387082    2579 scope.go:117] "RemoveContainer" containerID="5d30af050da19ac74c0c79f57c4c60e7c4ce8bfa5132db7405b1c78ae18ba8eb"
Jul 23 18:08:33.392360 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:33.392327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-z7vmp" event={"ID":"edb5cc0d-a911-4603-a27b-ae9041cdac85","Type":"ContainerStarted","Data":"cf5598b632831043e614a8716350bcb269b3e4fb97b23407862b77267dd8c545"}
Jul 23 18:08:33.701368 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:33.701276    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" podUID="6c135a41-c6df-48d1-a123-e2f9679ce278" containerName="registry" containerID="cri-o://d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e" gracePeriod=30
Jul 23 18:08:33.948828 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:33.948801    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:08:34.084009 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.083981    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq8wg\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084036    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token\") pod \"6c135a41-c6df-48d1-a123-e2f9679ce278\" (UID: \"6c135a41-c6df-48d1-a123-e2f9679ce278\") "
Jul 23 18:08:34.084580 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084546    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:08:34.084888 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.084608    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:08:34.086938 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.086881    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:34.087086 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.086982    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg" (OuterVolumeSpecName: "kube-api-access-qq8wg") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "kube-api-access-qq8wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:34.087086 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.087049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:34.087176 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.087123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:34.087219 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.087176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:34.093146 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.093118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6c135a41-c6df-48d1-a123-e2f9679ce278" (UID: "6c135a41-c6df-48d1-a123-e2f9679ce278"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:08:34.184822 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184804    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq8wg\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-kube-api-access-qq8wg\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184822 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184824    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c135a41-c6df-48d1-a123-e2f9679ce278-ca-trust-extracted\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184833    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-trusted-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184844    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-image-registry-private-configuration\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184853    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-certificates\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184861    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-registry-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184870    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c135a41-c6df-48d1-a123-e2f9679ce278-installation-pull-secrets\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.184959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.184878    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c135a41-c6df-48d1-a123-e2f9679ce278-bound-sa-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:08:34.398269 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.398205    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c135a41-c6df-48d1-a123-e2f9679ce278" containerID="d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e" exitCode=0
Jul 23 18:08:34.398612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.398268    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5449bdf756-8dppk"
Jul 23 18:08:34.398612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.398287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" event={"ID":"6c135a41-c6df-48d1-a123-e2f9679ce278","Type":"ContainerDied","Data":"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"}
Jul 23 18:08:34.398612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.398364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5449bdf756-8dppk" event={"ID":"6c135a41-c6df-48d1-a123-e2f9679ce278","Type":"ContainerDied","Data":"e3bad61b10cfd6edcad39c2f4d65d18fcc816423a63f47042a76c55211d9e06c"}
Jul 23 18:08:34.398612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.398386    2579 scope.go:117] "RemoveContainer" containerID="d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"
Jul 23 18:08:34.406987 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.406971    2579 scope.go:117] "RemoveContainer" containerID="d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"
Jul 23 18:08:34.407265 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:08:34.407247    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e\": container with ID starting with d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e not found: ID does not exist" containerID="d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"
Jul 23 18:08:34.407315 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.407272    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e"} err="failed to get container status \"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e\": rpc error: code = NotFound desc = could not find container \"d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e\": container with ID starting with d9064aeaf23a5f5e9329a1e28eb374651195d4d479a5891e935413c411d2523e not found: ID does not exist"
Jul 23 18:08:34.424072 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.424040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:08:34.430413 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.430393    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5449bdf756-8dppk"]
Jul 23 18:08:34.746758 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:34.746680    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c135a41-c6df-48d1-a123-e2f9679ce278" path="/var/lib/kubelet/pods/6c135a41-c6df-48d1-a123-e2f9679ce278/volumes"
Jul 23 18:08:47.459051 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:47.459016    2579 generic.go:356] "Generic (PLEG): container finished" podID="7fad7513-c439-4c95-9d24-bb3a24a04bcc" containerID="19d65e8c1f4d2f7a7c85ebf7032434a6d3daffe898e41cf2aa94ff63d3b88d4a" exitCode=0
Jul 23 18:08:47.459457 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:47.459058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s" event={"ID":"7fad7513-c439-4c95-9d24-bb3a24a04bcc","Type":"ContainerDied","Data":"19d65e8c1f4d2f7a7c85ebf7032434a6d3daffe898e41cf2aa94ff63d3b88d4a"}
Jul 23 18:08:47.459457 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:47.459364    2579 scope.go:117] "RemoveContainer" containerID="19d65e8c1f4d2f7a7c85ebf7032434a6d3daffe898e41cf2aa94ff63d3b88d4a"
Jul 23 18:08:48.465194 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:08:48.465157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-r987s" event={"ID":"7fad7513-c439-4c95-9d24-bb3a24a04bcc","Type":"ContainerStarted","Data":"efd5d18e2b41b605916b661ebbe75b736e4b55bf88c8d47420da3a9acc05ff3e"}
Jul 23 18:09:04.225392 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:09:04.225344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:09:04.242769 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:09:04.242743    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:09:04.547682 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:09:04.547615    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 18:11:30.622098 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:30.622068    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:11:30.628927 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:30.628902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:11:30.632234 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:30.632217    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:11:35.381660 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.381630    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"]
Jul 23 18:11:35.384027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.382001    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c135a41-c6df-48d1-a123-e2f9679ce278" containerName="registry"
Jul 23 18:11:35.384027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.382014    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c135a41-c6df-48d1-a123-e2f9679ce278" containerName="registry"
Jul 23 18:11:35.384027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.382096    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c135a41-c6df-48d1-a123-e2f9679ce278" containerName="registry"
Jul 23 18:11:35.384986 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.384964    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.389357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.389339    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 18:11:35.389759 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.389738    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:11:35.389862 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.389816    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 18:11:35.390245 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.390210    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 18:11:35.390537 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.390523    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bx4zl\""
Jul 23 18:11:35.398048 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.398030    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 18:11:35.403589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.403571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"]
Jul 23 18:11:35.486121 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.486090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.486233 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.486167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-metrics-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.486233 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.486204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4csh9\" (UniqueName: \"kubernetes.io/projected/cb3f940e-b167-458d-a5e8-6236a41e7ecf-kube-api-access-4csh9\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.486337 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.486233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb3f940e-b167-458d-a5e8-6236a41e7ecf-manager-config\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.587077 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.587046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.587275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.587101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-metrics-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.587275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.587129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4csh9\" (UniqueName: \"kubernetes.io/projected/cb3f940e-b167-458d-a5e8-6236a41e7ecf-kube-api-access-4csh9\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.587392 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.587327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb3f940e-b167-458d-a5e8-6236a41e7ecf-manager-config\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.588053 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.588022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cb3f940e-b167-458d-a5e8-6236a41e7ecf-manager-config\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.590346 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.590319    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.590448 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.590414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb3f940e-b167-458d-a5e8-6236a41e7ecf-metrics-cert\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.607093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.607061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4csh9\" (UniqueName: \"kubernetes.io/projected/cb3f940e-b167-458d-a5e8-6236a41e7ecf-kube-api-access-4csh9\") pod \"lws-controller-manager-7676b4f7b4-ck76h\" (UID: \"cb3f940e-b167-458d-a5e8-6236a41e7ecf\") " pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.693616 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.693545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:35.834367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.834314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"]
Jul 23 18:11:35.836664 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:11:35.836635    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3f940e_b167_458d_a5e8_6236a41e7ecf.slice/crio-d0cc76e106d2dcbc604e603ce429cbb80e5d9be5f55bf031d9034d780f0a4f5e WatchSource:0}: Error finding container d0cc76e106d2dcbc604e603ce429cbb80e5d9be5f55bf031d9034d780f0a4f5e: Status 404 returned error can't find the container with id d0cc76e106d2dcbc604e603ce429cbb80e5d9be5f55bf031d9034d780f0a4f5e
Jul 23 18:11:35.838731 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:35.838715    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:11:36.126584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.126550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h" event={"ID":"cb3f940e-b167-458d-a5e8-6236a41e7ecf","Type":"ContainerStarted","Data":"d0cc76e106d2dcbc604e603ce429cbb80e5d9be5f55bf031d9034d780f0a4f5e"}
Jul 23 18:11:36.540190 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.540116    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"]
Jul 23 18:11:36.544725 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.544704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.548028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.548009    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:11:36.549236 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.549219    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:11:36.549840 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.549818    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:11:36.550062 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.550047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:11:36.550275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.550258    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kmncx\""
Jul 23 18:11:36.561902 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.561882    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"]
Jul 23 18:11:36.696660 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.696632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mdm6\" (UniqueName: \"kubernetes.io/projected/94caa482-3f03-4fe8-aefb-a986a1071550-kube-api-access-9mdm6\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.696823 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.696681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-tmp\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.696823 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.696759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.696899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.696833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.696899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.696872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-manifests\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798075 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.797995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mdm6\" (UniqueName: \"kubernetes.io/projected/94caa482-3f03-4fe8-aefb-a986a1071550-kube-api-access-9mdm6\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798075 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.798054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-tmp\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798287 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.798092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798287 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.798125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798287 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.798174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-manifests\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.798569 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.798522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-manifests\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.800873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.800824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94caa482-3f03-4fe8-aefb-a986a1071550-tmp\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.801220 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.801169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.801556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.801532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94caa482-3f03-4fe8-aefb-a986a1071550-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.818150 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.818104    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mdm6\" (UniqueName: \"kubernetes.io/projected/94caa482-3f03-4fe8-aefb-a986a1071550-kube-api-access-9mdm6\") pod \"opendatahub-operator-controller-manager-56b5877c86-ttcbb\" (UID: \"94caa482-3f03-4fe8-aefb-a986a1071550\") " pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:36.856187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:36.856153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:37.019376 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:37.019235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"]
Jul 23 18:11:37.021879 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:11:37.021842    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94caa482_3f03_4fe8_aefb_a986a1071550.slice/crio-c069123ddd5031188e9380b3b7d00b8150e5e919546353df43cb77cf1828bfd7 WatchSource:0}: Error finding container c069123ddd5031188e9380b3b7d00b8150e5e919546353df43cb77cf1828bfd7: Status 404 returned error can't find the container with id c069123ddd5031188e9380b3b7d00b8150e5e919546353df43cb77cf1828bfd7
Jul 23 18:11:37.131813 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:37.131754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb" event={"ID":"94caa482-3f03-4fe8-aefb-a986a1071550","Type":"ContainerStarted","Data":"c069123ddd5031188e9380b3b7d00b8150e5e919546353df43cb77cf1828bfd7"}
Jul 23 18:11:39.145093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:39.145052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h" event={"ID":"cb3f940e-b167-458d-a5e8-6236a41e7ecf","Type":"ContainerStarted","Data":"b6249a68f8a0b80a1e88fdedfab8a432281c3475ca42869e4c49151b9a804d51"}
Jul 23 18:11:39.145531 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:39.145368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:39.173061 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:39.173003    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h" podStartSLOduration=1.003521066 podStartE2EDuration="4.172985718s" totalImagesPullingTime="3.169464652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:39.171671673 +0000 UTC m=+308.901104192" watchObservedRunningTime="2026-07-23 18:11:39.172985718 +0000 UTC m=+308.902418307"
Jul 23 18:11:41.161078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:41.161042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb" event={"ID":"94caa482-3f03-4fe8-aefb-a986a1071550","Type":"ContainerStarted","Data":"859c9f43ac16698d176c7e2e47705e414f4bb9b38a2546115dd1beff78821bd4"}
Jul 23 18:11:42.167317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:42.167242    2579 generic.go:356] "Generic (PLEG): container finished" podID="94caa482-3f03-4fe8-aefb-a986a1071550" containerID="859c9f43ac16698d176c7e2e47705e414f4bb9b38a2546115dd1beff78821bd4" exitCode=0
Jul 23 18:11:42.167317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:42.167291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb" event={"ID":"94caa482-3f03-4fe8-aefb-a986a1071550","Type":"ContainerDied","Data":"859c9f43ac16698d176c7e2e47705e414f4bb9b38a2546115dd1beff78821bd4"}
Jul 23 18:11:43.173381 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:43.173348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb" event={"ID":"94caa482-3f03-4fe8-aefb-a986a1071550","Type":"ContainerStarted","Data":"b963ab7014e584f1141e24739e06e21255c1e3caa3ae0dce833fb599add78691"}
Jul 23 18:11:43.173839 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:43.173419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:11:43.201185 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:43.201136    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb" podStartSLOduration=1.991805005 podStartE2EDuration="7.201120633s" totalImagesPullingTime="4.161338793s" totalInitContainerRuntime="1.047976835s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:43.199511134 +0000 UTC m=+312.928943652" watchObservedRunningTime="2026-07-23 18:11:43.201120633 +0000 UTC m=+312.930553151"
Jul 23 18:11:50.152385 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:50.152352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7676b4f7b4-ck76h"
Jul 23 18:11:54.179987 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:11:54.179958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56b5877c86-ttcbb"
Jul 23 18:12:01.818374 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.818338    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"]
Jul 23 18:12:01.830522 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.830484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.833982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.833961    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fmsdv\""
Jul 23 18:12:01.834357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.834333    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 18:12:01.835880 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.835864    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 18:12:01.840657 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.840633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"]
Jul 23 18:12:01.893945 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.893918    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5tkp\" (UniqueName: \"kubernetes.io/projected/5ceee695-e727-452a-8b8d-89a0e51d8652-kube-api-access-n5tkp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.894048 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.893974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ceee695-e727-452a-8b8d-89a0e51d8652-tls-certs\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.894089 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.894050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceee695-e727-452a-8b8d-89a0e51d8652-tmp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.995234 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.995199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ceee695-e727-452a-8b8d-89a0e51d8652-tls-certs\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.995375 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.995249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceee695-e727-452a-8b8d-89a0e51d8652-tmp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.995375 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.995291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5tkp\" (UniqueName: \"kubernetes.io/projected/5ceee695-e727-452a-8b8d-89a0e51d8652-kube-api-access-n5tkp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.997676 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.997647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ceee695-e727-452a-8b8d-89a0e51d8652-tmp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:01.997676 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:01.997665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ceee695-e727-452a-8b8d-89a0e51d8652-tls-certs\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:02.005762 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:02.005741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5tkp\" (UniqueName: \"kubernetes.io/projected/5ceee695-e727-452a-8b8d-89a0e51d8652-kube-api-access-n5tkp\") pod \"kube-auth-proxy-f87ff99bf-cpn79\" (UID: \"5ceee695-e727-452a-8b8d-89a0e51d8652\") " pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:02.141441 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:02.141382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"
Jul 23 18:12:02.280716 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:02.280682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79"]
Jul 23 18:12:02.282883 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:12:02.282857    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ceee695_e727_452a_8b8d_89a0e51d8652.slice/crio-da5cffcb67d70bfc79fb5ebab62a3cc3baf20fecc3740bc8fb924f63a376a157 WatchSource:0}: Error finding container da5cffcb67d70bfc79fb5ebab62a3cc3baf20fecc3740bc8fb924f63a376a157: Status 404 returned error can't find the container with id da5cffcb67d70bfc79fb5ebab62a3cc3baf20fecc3740bc8fb924f63a376a157
Jul 23 18:12:03.261650 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:03.261617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79" event={"ID":"5ceee695-e727-452a-8b8d-89a0e51d8652","Type":"ContainerStarted","Data":"da5cffcb67d70bfc79fb5ebab62a3cc3baf20fecc3740bc8fb924f63a376a157"}
Jul 23 18:12:06.277856 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:06.277810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79" event={"ID":"5ceee695-e727-452a-8b8d-89a0e51d8652","Type":"ContainerStarted","Data":"162b11849a095a1d8749537c7545166cc938c58fd113c7cb12f04290c355fdb4"}
Jul 23 18:12:06.297208 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:12:06.297145    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f87ff99bf-cpn79" podStartSLOduration=2.142043933 podStartE2EDuration="5.297127309s" totalImagesPullingTime="3.155083376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:06.296693509 +0000 UTC m=+336.026126026" watchObservedRunningTime="2026-07-23 18:12:06.297127309 +0000 UTC m=+336.026559826"
Jul 23 18:13:49.292916 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.292883    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"]
Jul 23 18:13:49.296593 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.296572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.299279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.299254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 18:13:49.299413 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.299299    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 18:13:49.299413 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.299382    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k9zht\""
Jul 23 18:13:49.299413 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.299389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:13:49.299969 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.299956    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:13:49.304196 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.304176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"]
Jul 23 18:13:49.437662 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.437632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.437813 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.437691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqsr7\" (UniqueName: \"kubernetes.io/projected/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-kube-api-access-hqsr7\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.437813 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.437758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.538901 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.538876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqsr7\" (UniqueName: \"kubernetes.io/projected/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-kube-api-access-hqsr7\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.539013 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.538916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.539013 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.538962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.539096 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:13:49.539054    2579 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 18:13:49.539129 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:13:49.539108    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert podName:8f2f4e36-0c31-44ef-8a09-5cad13bc06ad nodeName:}" failed. No retries permitted until 2026-07-23 18:13:50.039090153 +0000 UTC m=+439.768522649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-8q95k" (UID: "8f2f4e36-0c31-44ef-8a09-5cad13bc06ad") : secret "plugin-serving-cert" not found
Jul 23 18:13:49.539583 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.539562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:49.561847 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:49.561824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqsr7\" (UniqueName: \"kubernetes.io/projected/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-kube-api-access-hqsr7\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:50.042990 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:50.042906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:50.045409 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:50.045383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f2f4e36-0c31-44ef-8a09-5cad13bc06ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8q95k\" (UID: \"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:50.212868 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:50.212832    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"
Jul 23 18:13:50.344702 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:50.344627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k"]
Jul 23 18:13:50.347040 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:13:50.347014    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f2f4e36_0c31_44ef_8a09_5cad13bc06ad.slice/crio-34fe2a28c8b5a7884e1d9658f8f9a641589a8e55c32ef58e2631ebb984e53a51 WatchSource:0}: Error finding container 34fe2a28c8b5a7884e1d9658f8f9a641589a8e55c32ef58e2631ebb984e53a51: Status 404 returned error can't find the container with id 34fe2a28c8b5a7884e1d9658f8f9a641589a8e55c32ef58e2631ebb984e53a51
Jul 23 18:13:50.747252 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:13:50.747218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k" event={"ID":"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad","Type":"ContainerStarted","Data":"34fe2a28c8b5a7884e1d9658f8f9a641589a8e55c32ef58e2631ebb984e53a51"}
Jul 23 18:14:14.868278 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:14.868237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k" event={"ID":"8f2f4e36-0c31-44ef-8a09-5cad13bc06ad","Type":"ContainerStarted","Data":"5334ad87352394fb33588b0eccfca0a4f974480fb5d11e79ce31ceb08a60f620"}
Jul 23 18:14:14.888035 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:14.887978    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8q95k" podStartSLOduration=2.022973934 podStartE2EDuration="25.88796119s" totalImagesPullingTime="23.864987256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:14.887421639 +0000 UTC m=+464.616854157" watchObservedRunningTime="2026-07-23 18:14:14.88796119 +0000 UTC m=+464.617393708"
Jul 23 18:14:41.865126 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:41.865090    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:14:41.934213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:41.934178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:14:41.934213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:41.934221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:14:41.934433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:41.934288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:41.938284 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:41.938253    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 18:14:42.009120 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.009089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dfae5232-804f-41dc-9eb7-e3703d850d3f-config-file\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.009257 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.009190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgb7t\" (UniqueName: \"kubernetes.io/projected/dfae5232-804f-41dc-9eb7-e3703d850d3f-kube-api-access-rgb7t\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.110056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.110026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dfae5232-804f-41dc-9eb7-e3703d850d3f-config-file\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.110191 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.110079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgb7t\" (UniqueName: \"kubernetes.io/projected/dfae5232-804f-41dc-9eb7-e3703d850d3f-kube-api-access-rgb7t\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.110769 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.110749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dfae5232-804f-41dc-9eb7-e3703d850d3f-config-file\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.120890 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.120836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgb7t\" (UniqueName: \"kubernetes.io/projected/dfae5232-804f-41dc-9eb7-e3703d850d3f-kube-api-access-rgb7t\") pod \"limitador-limitador-54d6d988d5-bfk97\" (UID: \"dfae5232-804f-41dc-9eb7-e3703d850d3f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.245959 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.245939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:42.505903 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.505877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:14:42.509013 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:14:42.508976    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfae5232_804f_41dc_9eb7_e3703d850d3f.slice/crio-b6dc9b544b79b3498ca24fba792b613d16cc7ab58a314825a729f9eaa1424cdd WatchSource:0}: Error finding container b6dc9b544b79b3498ca24fba792b613d16cc7ab58a314825a729f9eaa1424cdd: Status 404 returned error can't find the container with id b6dc9b544b79b3498ca24fba792b613d16cc7ab58a314825a729f9eaa1424cdd
Jul 23 18:14:42.994896 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:42.994858    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97" event={"ID":"dfae5232-804f-41dc-9eb7-e3703d850d3f","Type":"ContainerStarted","Data":"b6dc9b544b79b3498ca24fba792b613d16cc7ab58a314825a729f9eaa1424cdd"}
Jul 23 18:14:46.010727 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:46.010695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97" event={"ID":"dfae5232-804f-41dc-9eb7-e3703d850d3f","Type":"ContainerStarted","Data":"eb8c6144cffaae8dbc2b8a6ba581c694f8a28c4cefbc7820e5163f7ac9efaa05"}
Jul 23 18:14:46.011166 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:46.010749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:14:46.031030 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:46.030985    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97" podStartSLOduration=2.302071749 podStartE2EDuration="5.030970064s" totalImagesPullingTime="2.728898315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:46.029036 +0000 UTC m=+495.758468534" watchObservedRunningTime="2026-07-23 18:14:46.030970064 +0000 UTC m=+495.760402621"
Jul 23 18:14:57.015902 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:14:57.015872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bfk97"
Jul 23 18:15:59.633832 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:15:59.633754    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:16:25.145201 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:25.145160    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:16:30.651820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:30.651774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:16:30.656601 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:30.656578    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:16:37.275328 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:37.275298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:16:47.383922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:47.383885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:16:53.074571 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.074491    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"]
Jul 23 18:16:53.078226 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.078200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.080694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.080675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:16:53.081373 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.081355    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:16:53.081441 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.081406    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 18:16:53.081494 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.081445    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dj6jj\""
Jul 23 18:16:53.090042 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.090019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"]
Jul 23 18:16:53.172944 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.172908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6csn\" (UniqueName: \"kubernetes.io/projected/b893b5a1-cb23-4322-b992-13fb02a4aaa4-kube-api-access-d6csn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.172944 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.172947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.173138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.172985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.173138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.173061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.173138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.173097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.173138 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.173129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.273883 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.273851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274020 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.273890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274020 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.273938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274020 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6csn\" (UniqueName: \"kubernetes.io/projected/b893b5a1-cb23-4322-b992-13fb02a4aaa4-kube-api-access-d6csn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274328 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274399 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.274437 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.274408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.276546 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.276523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b893b5a1-cb23-4322-b992-13fb02a4aaa4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.276648 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.276604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b893b5a1-cb23-4322-b992-13fb02a4aaa4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.283028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.283006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6csn\" (UniqueName: \"kubernetes.io/projected/b893b5a1-cb23-4322-b992-13fb02a4aaa4-kube-api-access-d6csn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf\" (UID: \"b893b5a1-cb23-4322-b992-13fb02a4aaa4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.388376 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.388294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:16:53.520147 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.520125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"]
Jul 23 18:16:53.522727 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:16:53.522696    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb893b5a1_cb23_4322_b992_13fb02a4aaa4.slice/crio-2cfe89c66c3ebebbad249dc6746d88d586c2961dcc34c2fa92cea873d89dafd3 WatchSource:0}: Error finding container 2cfe89c66c3ebebbad249dc6746d88d586c2961dcc34c2fa92cea873d89dafd3: Status 404 returned error can't find the container with id 2cfe89c66c3ebebbad249dc6746d88d586c2961dcc34c2fa92cea873d89dafd3
Jul 23 18:16:53.524093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.524071    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:16:53.584659 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:53.584626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf" event={"ID":"b893b5a1-cb23-4322-b992-13fb02a4aaa4","Type":"ContainerStarted","Data":"2cfe89c66c3ebebbad249dc6746d88d586c2961dcc34c2fa92cea873d89dafd3"}
Jul 23 18:16:54.995664 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:54.995637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:16:55.597072 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:55.597040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf" event={"ID":"b893b5a1-cb23-4322-b992-13fb02a4aaa4","Type":"ContainerStarted","Data":"a98a8d67fa2ea884d8f06b632208767817746f7dc967909062d04ab4f4d3379f"}
Jul 23 18:16:55.616051 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:16:55.616001    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf" podStartSLOduration=1.126077629 podStartE2EDuration="2.615987906s" totalImagesPullingTime="1.489910277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:55.614542284 +0000 UTC m=+625.343974823" watchObservedRunningTime="2026-07-23 18:16:55.615987906 +0000 UTC m=+625.345420423"
Jul 23 18:17:03.389097 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:03.389066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:17:03.389679 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:03.389131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:17:03.401590 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:03.401567    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:17:03.644288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:03.644214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf"
Jul 23 18:17:13.882583 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.882549    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"]
Jul 23 18:17:13.888919 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.888898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.891200 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.891180    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 18:17:13.898336 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.898312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"]
Jul 23 18:17:13.937227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.937339 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8tc2\" (UniqueName: \"kubernetes.io/projected/c227f42a-288a-41b4-88dc-8aab17d0fe76-kube-api-access-k8tc2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.937396 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.937396 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.937483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c227f42a-288a-41b4-88dc-8aab17d0fe76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:13.937483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:13.937445    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038479 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038570 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038570 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c227f42a-288a-41b4-88dc-8aab17d0fe76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038570 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038570 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038746 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8tc2\" (UniqueName: \"kubernetes.io/projected/c227f42a-288a-41b4-88dc-8aab17d0fe76-kube-api-access-k8tc2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038867 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.038969 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.038912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.039038 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.039010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.040988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.040969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c227f42a-288a-41b4-88dc-8aab17d0fe76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.041140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.041123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c227f42a-288a-41b4-88dc-8aab17d0fe76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.047905 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.047885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8tc2\" (UniqueName: \"kubernetes.io/projected/c227f42a-288a-41b4-88dc-8aab17d0fe76-kube-api-access-k8tc2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rdkf9\" (UID: \"c227f42a-288a-41b4-88dc-8aab17d0fe76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.199754 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.199695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:14.334511 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.334486    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"]
Jul 23 18:17:14.336794 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:17:14.336751    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc227f42a_288a_41b4_88dc_8aab17d0fe76.slice/crio-752f98e9b1151ab320f25e0375352c9e194e95f92b1cd3b43378fbb2795aa260 WatchSource:0}: Error finding container 752f98e9b1151ab320f25e0375352c9e194e95f92b1cd3b43378fbb2795aa260: Status 404 returned error can't find the container with id 752f98e9b1151ab320f25e0375352c9e194e95f92b1cd3b43378fbb2795aa260
Jul 23 18:17:14.694277 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.694240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9" event={"ID":"c227f42a-288a-41b4-88dc-8aab17d0fe76","Type":"ContainerStarted","Data":"c8fce932c4a9074cccb4e6ed169e83377b81a429aad64777e7bf9ecfd9c09488"}
Jul 23 18:17:14.694399 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.694298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9" event={"ID":"c227f42a-288a-41b4-88dc-8aab17d0fe76","Type":"ContainerStarted","Data":"752f98e9b1151ab320f25e0375352c9e194e95f92b1cd3b43378fbb2795aa260"}
Jul 23 18:17:14.712456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:14.712160    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9" podStartSLOduration=1.494202132 podStartE2EDuration="1.712141002s" totalImagesPullingTime="217.93887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:14.711607324 +0000 UTC m=+644.441039841" watchObservedRunningTime="2026-07-23 18:17:14.712141002 +0000 UTC m=+644.441573521"
Jul 23 18:17:16.776573 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:16.776534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:17:21.873482 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:21.873449    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"]
Jul 23 18:17:21.877161 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:21.877139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:21.879694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:21.879673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 18:17:21.887335 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:21.887316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"]
Jul 23 18:17:22.007884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.007859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.008015 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.007920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.008015 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.007971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgvh2\" (UniqueName: \"kubernetes.io/projected/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-kube-api-access-qgvh2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.008015 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.008009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.008114 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.008056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.008148 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.008116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109579 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgvh2\" (UniqueName: \"kubernetes.io/projected/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-kube-api-access-qgvh2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109579 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109579 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109579 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109819 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.109953 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.110021 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.109977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.110074 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.110016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.111861 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.111834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.112110 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.112093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.118342 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.118324    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgvh2\" (UniqueName: \"kubernetes.io/projected/12df3636-5aa7-4ff1-93d9-df41d5ef54a1-kube-api-access-qgvh2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dm674\" (UID: \"12df3636-5aa7-4ff1-93d9-df41d5ef54a1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.188106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.188051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:22.322620 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.322596    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"]
Jul 23 18:17:22.325197 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:17:22.325168    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12df3636_5aa7_4ff1_93d9_df41d5ef54a1.slice/crio-0f623978fab02ab89647553e594c6d018fd0dd10e00e99718b2559fe70a1a9c7 WatchSource:0}: Error finding container 0f623978fab02ab89647553e594c6d018fd0dd10e00e99718b2559fe70a1a9c7: Status 404 returned error can't find the container with id 0f623978fab02ab89647553e594c6d018fd0dd10e00e99718b2559fe70a1a9c7
Jul 23 18:17:22.729836 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:22.729799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674" event={"ID":"12df3636-5aa7-4ff1-93d9-df41d5ef54a1","Type":"ContainerStarted","Data":"0f623978fab02ab89647553e594c6d018fd0dd10e00e99718b2559fe70a1a9c7"}
Jul 23 18:17:23.736273 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:23.736236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674" event={"ID":"12df3636-5aa7-4ff1-93d9-df41d5ef54a1","Type":"ContainerStarted","Data":"5d6e947b13df251c0f58e0c417882952f0be3e19e1755da273e877f3eb200050"}
Jul 23 18:17:23.770967 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:23.770917    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674" podStartSLOduration=2.119393498 podStartE2EDuration="2.770902998s" totalImagesPullingTime="651.5095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:23.769465192 +0000 UTC m=+653.498897714" watchObservedRunningTime="2026-07-23 18:17:23.770902998 +0000 UTC m=+653.500335515"
Jul 23 18:17:24.200580 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:24.200550    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:24.200761 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:24.200603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:24.212685 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:24.212665    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:24.756618 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:24.756587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rdkf9"
Jul 23 18:17:32.188499 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:32.188462    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:32.188902 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:32.188511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:32.201034 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:32.201015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:17:32.381424 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:32.381393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:17:32.789007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:17:32.788982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dm674"
Jul 23 18:19:10.780588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:19:10.780555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:19:22.275908 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:19:22.275874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:19:32.684058 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:19:32.684019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:21:16.083210 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:21:16.083176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:21:29.481266 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:21:29.481184    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:21:30.681337 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:21:30.681307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:21:30.683898 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:21:30.683874    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:22:05.189851 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:05.189811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:22:14.377262 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:14.377219    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:22:24.982899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:24.982858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:22:33.181881 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:33.181849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:22:45.278683 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:45.278648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:22:55.271185 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:22:55.271112    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:23:08.277519 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:23:08.277484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:23:18.374911 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:23:18.374876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:23:39.776433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:23:39.776396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:23:49.878370 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:23:49.878333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:24:14.281547 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:24:14.281513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:24:27.677075 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:24:27.677042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:24:43.080359 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:24:43.080318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:24:52.976640 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:24:52.976607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:25:03.478386 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:25:03.478352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:25:13.672585 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:25:13.672552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:25:23.678553 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:25:23.678520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:26:30.710799 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:26:30.710755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:26:30.711282 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:26:30.710971    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:27:11.479991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:27:11.479960    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:27:23.481448 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:27:23.481368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:27:32.972800 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:27:32.972746    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:27:44.076457 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:27:44.076424    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:27:56.276456 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:27:56.276427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:06.472713 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:06.472676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:14.501079 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:14.501044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:26.671572 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:26.671534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:36.877380 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:36.877340    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:46.077480 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:46.077448    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:28:57.181440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:28:57.181361    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:29:21.690060 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:21.690024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:29:29.790321 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:29.790288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:29:42.586355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.586322    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:29:42.589660 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.589641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.591846 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.591828    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-64702bec-kserve-self-signed-certs\""
Jul 23 18:29:42.609724 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.609692    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:29:42.688157 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.688286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.688286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.688286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.688411 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2m7\" (UniqueName: \"kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.688411 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.688320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.788951 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.788926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.788961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2m7\" (UniqueName: \"kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789063 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789155 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789340 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789507 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789566 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.789693 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.789678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.791543 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.791520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.791644 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.791569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.798166 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.798147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2m7\" (UniqueName: \"kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7\") pod \"e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") " pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:42.898918 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:42.898865    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:43.035925 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:43.035893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:29:43.039774 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:29:43.039751    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b67ae9b_c440_4732_9f9b_c6a134fb6ab8.slice/crio-1bffacd6d1f9cdba1f4160627c3086e6fbc44d4fe63cae4087d718b616e9d1f7 WatchSource:0}: Error finding container 1bffacd6d1f9cdba1f4160627c3086e6fbc44d4fe63cae4087d718b616e9d1f7: Status 404 returned error can't find the container with id 1bffacd6d1f9cdba1f4160627c3086e6fbc44d4fe63cae4087d718b616e9d1f7
Jul 23 18:29:43.105216 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:43.105188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" event={"ID":"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8","Type":"ContainerStarted","Data":"1bffacd6d1f9cdba1f4160627c3086e6fbc44d4fe63cae4087d718b616e9d1f7"}
Jul 23 18:29:44.110955 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:44.110921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" event={"ID":"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8","Type":"ContainerStarted","Data":"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"}
Jul 23 18:29:44.129106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:44.129059    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" podStartSLOduration=2.12904581 podStartE2EDuration="2.12904581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:29:44.128284721 +0000 UTC m=+1393.857717239" watchObservedRunningTime="2026-07-23 18:29:44.12904581 +0000 UTC m=+1393.858478329"
Jul 23 18:29:45.679582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:45.679544    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:29:52.899069 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:52.898996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:52.899069 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:52.899045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:52.911664 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:52.911637    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:53.164949 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:53.164873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:29:55.475235 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.475202    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:29:55.479002 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.478983    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.481279 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.481255    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-64702bec-kserve-self-signed-certs\""
Jul 23 18:29:55.489484 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.489460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:29:55.601292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.601459 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.601459 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.601459 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4w6\" (UniqueName: \"kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.601602 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.601602 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.601543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4w6\" (UniqueName: \"kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702470 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702470 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702470 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702620 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702719 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.702897 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.702873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.704735 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.704717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.705029 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.705010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.710584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.710557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4w6\" (UniqueName: \"kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6\") pod \"e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") " pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.789357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.789298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:29:55.923875 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:55.923850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:29:55.926168 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:29:55.926138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a0cd76b_948c_49d8_9526_218ef5d5aa9f.slice/crio-0a382a5eeb557c4d2cc98a5018504269a4a9540e5a76f058f36c86d8543bff6c WatchSource:0}: Error finding container 0a382a5eeb557c4d2cc98a5018504269a4a9540e5a76f058f36c86d8543bff6c: Status 404 returned error can't find the container with id 0a382a5eeb557c4d2cc98a5018504269a4a9540e5a76f058f36c86d8543bff6c
Jul 23 18:29:56.168580 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:56.168551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" event={"ID":"7a0cd76b-948c-49d8-9526-218ef5d5aa9f","Type":"ContainerStarted","Data":"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"}
Jul 23 18:29:56.168735 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:56.168589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" event={"ID":"7a0cd76b-948c-49d8-9526-218ef5d5aa9f","Type":"ContainerStarted","Data":"0a382a5eeb557c4d2cc98a5018504269a4a9540e5a76f058f36c86d8543bff6c"}
Jul 23 18:29:56.188332 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:29:56.188286    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" podStartSLOduration=1.188266968 podStartE2EDuration="1.188266968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:29:56.1860634 +0000 UTC m=+1405.915495915" watchObservedRunningTime="2026-07-23 18:29:56.188266968 +0000 UTC m=+1405.917699483"
Jul 23 18:30:00.575017 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:00.574986    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:30:05.789971 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:05.789938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:05.790330 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:05.789982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:05.802122 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:05.802091    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:06.236754 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:06.236726    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:14.558360 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:14.558328    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:30:15.957882 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:15.957843    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:30:18.180563 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:18.180525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:30:29.580971 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.580868    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" podUID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" containerName="main" containerID="cri-o://e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad" gracePeriod=45
Jul 23 18:30:29.837394 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.837336    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:30:29.878960 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.878937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.878966    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.878999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879020    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879041    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879332 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879142    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2m7\" (UniqueName: \"kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7\") pod \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\" (UID: \"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8\") "
Jul 23 18:30:29.879332 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:29.879438 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:29.879438 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home" (OuterVolumeSpecName: "home") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:29.879549 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879514    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:29.879549 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879535    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:29.879656 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.879552    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:29.881327 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.881297    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7" (OuterVolumeSpecName: "kube-api-access-rz2m7") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "kube-api-access-rz2m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:30:29.881428 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.881332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:30:29.881428 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.881338    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm" (OuterVolumeSpecName: "dshm") pod "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" (UID: "3b67ae9b-c440-4732-9f9b-c6a134fb6ab8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:29.980668 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.980642    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:29.980668 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.980665    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2m7\" (UniqueName: \"kubernetes.io/projected/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-kube-api-access-rz2m7\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:29.980831 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:29.980673    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:30.339106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.339076    2579 generic.go:356] "Generic (PLEG): container finished" podID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" containerID="e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad" exitCode=0
Jul 23 18:30:30.339288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.339120    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"
Jul 23 18:30:30.339288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.339165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" event={"ID":"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8","Type":"ContainerDied","Data":"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"}
Jul 23 18:30:30.339288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.339210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q" event={"ID":"3b67ae9b-c440-4732-9f9b-c6a134fb6ab8","Type":"ContainerDied","Data":"1bffacd6d1f9cdba1f4160627c3086e6fbc44d4fe63cae4087d718b616e9d1f7"}
Jul 23 18:30:30.339288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.339230    2579 scope.go:117] "RemoveContainer" containerID="e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"
Jul 23 18:30:30.348828 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.348798    2579 scope.go:117] "RemoveContainer" containerID="e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"
Jul 23 18:30:30.349059 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:30:30.349042    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad\": container with ID starting with e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad not found: ID does not exist" containerID="e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"
Jul 23 18:30:30.349109 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.349068    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad"} err="failed to get container status \"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad\": rpc error: code = NotFound desc = could not find container \"e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad\": container with ID starting with e14a0c2733d8cb3529a1135af8d74dbad90a21ce6a4ce3fb22b1c6f80abee4ad not found: ID does not exist"
Jul 23 18:30:30.362229 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.362209    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:30:30.367455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.367435    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-64702bec-kserve-5b7fff6bc9-4xt2q"]
Jul 23 18:30:30.747619 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.747545    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" path="/var/lib/kubelet/pods/3b67ae9b-c440-4732-9f9b-c6a134fb6ab8/volumes"
Jul 23 18:30:30.979538 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:30.979477    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" podUID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" containerName="main" containerID="cri-o://89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330" gracePeriod=45
Jul 23 18:30:31.227866 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.227844    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:31.290433 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290410    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290440    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290552 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290716 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn4w6\" (UniqueName: \"kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290716 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir\") pod \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\" (UID: \"7a0cd76b-948c-49d8-9526-218ef5d5aa9f\") "
Jul 23 18:30:31.290716 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290675    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:31.290899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290750    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home" (OuterVolumeSpecName: "home") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:31.290899 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290823    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.290992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.290934    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:31.292691 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.292669    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm" (OuterVolumeSpecName: "dshm") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:30:31.292807 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.292724    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6" (OuterVolumeSpecName: "kube-api-access-wn4w6") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "kube-api-access-wn4w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:30:31.292807 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.292724    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a0cd76b-948c-49d8-9526-218ef5d5aa9f" (UID: "7a0cd76b-948c-49d8-9526-218ef5d5aa9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:30:31.345478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.345421    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" containerID="89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330" exitCode=0
Jul 23 18:30:31.345478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.345460    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"
Jul 23 18:30:31.345588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.345508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" event={"ID":"7a0cd76b-948c-49d8-9526-218ef5d5aa9f","Type":"ContainerDied","Data":"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"}
Jul 23 18:30:31.345588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.345544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7" event={"ID":"7a0cd76b-948c-49d8-9526-218ef5d5aa9f","Type":"ContainerDied","Data":"0a382a5eeb557c4d2cc98a5018504269a4a9540e5a76f058f36c86d8543bff6c"}
Jul 23 18:30:31.345588 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.345561    2579 scope.go:117] "RemoveContainer" containerID="89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"
Jul 23 18:30:31.354643 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.354627    2579 scope.go:117] "RemoveContainer" containerID="89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"
Jul 23 18:30:31.354959 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:30:31.354937    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330\": container with ID starting with 89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330 not found: ID does not exist" containerID="89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"
Jul 23 18:30:31.355051 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.354963    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330"} err="failed to get container status \"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330\": rpc error: code = NotFound desc = could not find container \"89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330\": container with ID starting with 89acf637dcae0c0beaad451d8d3d6bd894c9f1ccb581d940071e0459c69f0330 not found: ID does not exist"
Jul 23 18:30:31.367658 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.367638    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:30:31.372599 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.372578    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-64702bec-kserve-74d4986c7f-2vrk7"]
Jul 23 18:30:31.392127 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.392105    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn4w6\" (UniqueName: \"kubernetes.io/projected/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-kube-api-access-wn4w6\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.392206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.392126    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.392206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.392138    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.392206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.392146    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.392206 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.392154    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a0cd76b-948c-49d8-9526-218ef5d5aa9f-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:30:31.980732 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:31.980703    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:30:32.747215 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:32.747178    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" path="/var/lib/kubelet/pods/7a0cd76b-948c-49d8-9526-218ef5d5aa9f/volumes"
Jul 23 18:30:41.689741 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:41.689706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:30:54.578665 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:30:54.578633    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:04.571561 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:04.571527    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:14.576001 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:14.575966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:22.677870 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:22.677835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:30.741094 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:30.741061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:31:30.744199 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:30.744169    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:31:33.983341 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:33.983308    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:43.770862 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:43.770829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:31:56.871589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:31:56.871510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:32:05.978235 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:32:05.978202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:32:15.879628 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:32:15.879596    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:32:28.574711 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:32:28.574679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:32:40.089332 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:32:40.089298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:32:49.507703 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:32:49.507669    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:33:01.993550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:33:01.993509    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:33:13.777914 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:33:13.777880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:33:27.092654 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:33:27.092570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:33:41.804302 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:33:41.804271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:33:53.781426 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:33:53.781392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:34:07.475040 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:34:07.475003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:34:43.280275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:34:43.280237    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:34:54.769130 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:34:54.769057    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:35:27.088906 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:35:27.088826    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:35:38.274369 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:35:38.274333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:36:10.879246 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:36:10.879210    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:36:22.275696 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:36:22.275618    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:36:30.770200 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:36:30.770170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:36:30.774694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:36:30.774673    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:36:55.375939 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:36:55.375904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:38:26.372661 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:38:26.372622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:38:35.890750 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:38:35.890708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:38:50.582410 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:38:50.582370    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:39:08.880213 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:08.880181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:39:46.575859 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:46.575761    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:39:55.881231 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881189    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:39:55.881728 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881708    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" containerName="main"
Jul 23 18:39:55.881834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881732    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" containerName="main"
Jul 23 18:39:55.881834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881744    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" containerName="main"
Jul 23 18:39:55.881834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" containerName="main"
Jul 23 18:39:55.881989 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881891    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b67ae9b-c440-4732-9f9b-c6a134fb6ab8" containerName="main"
Jul 23 18:39:55.881989 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.881904    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0cd76b-948c-49d8-9526-218ef5d5aa9f" containerName="main"
Jul 23 18:39:55.885106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.885085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.888922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.888891    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-368d7465\"/\"openshift-service-ca.crt\""
Jul 23 18:39:55.889028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.888958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-368d7465\"/\"e2e-lifecycle-model-368d7465-kserve-self-signed-certs\""
Jul 23 18:39:55.889028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.888985    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-368d7465\"/\"kube-root-ca.crt\""
Jul 23 18:39:55.889142 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.888893    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-368d7465\"/\"default-dockercfg-gcqsq\""
Jul 23 18:39:55.895039 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.895019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:39:55.989119 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.989292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w222f\" (UniqueName: \"kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.989292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.989292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.989417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:55.989417 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:55.989320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.089931 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.089898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.089936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w222f\" (UniqueName: \"kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.089964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090078 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090240 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090240 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090444 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090558 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.090558 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.090512    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.092517 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.092495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.092663 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.092648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.100003 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.099985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w222f\" (UniqueName: \"kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f\") pod \"e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") " pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.195423 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.195368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:39:56.332397 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.332359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:39:56.336009 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:39:56.335986    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda270bf6a_5f13_4f4c_9d09_44a0a49aeaac.slice/crio-3a2324800cd469919f5b6491ca71a9b88c1303053a26ddc4919af5093ff91dbd WatchSource:0}: Error finding container 3a2324800cd469919f5b6491ca71a9b88c1303053a26ddc4919af5093ff91dbd: Status 404 returned error can't find the container with id 3a2324800cd469919f5b6491ca71a9b88c1303053a26ddc4919af5093ff91dbd
Jul 23 18:39:56.923107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.923072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" event={"ID":"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac","Type":"ContainerStarted","Data":"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"}
Jul 23 18:39:56.923107 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.923114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" event={"ID":"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac","Type":"ContainerStarted","Data":"3a2324800cd469919f5b6491ca71a9b88c1303053a26ddc4919af5093ff91dbd"}
Jul 23 18:39:56.942844 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:56.942798    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" podStartSLOduration=1.942764822 podStartE2EDuration="1.942764822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:56.941794296 +0000 UTC m=+2006.671226818" watchObservedRunningTime="2026-07-23 18:39:56.942764822 +0000 UTC m=+2006.672197318"
Jul 23 18:39:59.595508 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:39:59.595476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:40:06.196447 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:06.196413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:40:06.196891 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:06.196459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:40:06.208672 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:06.208650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:40:06.981298 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:06.981259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:40:18.074286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:18.074248    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:40:38.788489 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:38.788453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:40:47.879211 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:47.879175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:40:51.826654 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:40:51.826572    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:41:06.848061 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:06.848001    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerName="main" containerID="cri-o://835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8" gracePeriod=45
Jul 23 18:41:06.970593 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:06.970552    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerName="main" probeResult="failure" output="Get \"https://10.132.0.35:8000/ready\": dial tcp 10.132.0.35:8000: connect: connection refused"
Jul 23 18:41:07.097762 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.097741    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:41:07.180496 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180425    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w222f\" (UniqueName: \"kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180496 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180673 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180506    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180673 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180806 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180713    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180806 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm\") pod \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\" (UID: \"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac\") "
Jul 23 18:41:07.180806 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180739    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:07.180976 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180893    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache" (OuterVolumeSpecName: "model-cache") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:07.181028 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.180972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home" (OuterVolumeSpecName: "home") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:07.181156 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.181135    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:07.181156 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.181162    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:07.181259 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.181176    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:07.183292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.183269    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm" (OuterVolumeSpecName: "dshm") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:07.183379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.183307    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:07.183379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.183333    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f" (OuterVolumeSpecName: "kube-api-access-w222f") pod "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" (UID: "a270bf6a-5f13-4f4c-9d09-44a0a49aeaac"). InnerVolumeSpecName "kube-api-access-w222f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:07.244098 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.244067    2579 generic.go:356] "Generic (PLEG): container finished" podID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerID="835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8" exitCode=0
Jul 23 18:41:07.244258 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.244118    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"
Jul 23 18:41:07.244258 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.244132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" event={"ID":"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac","Type":"ContainerDied","Data":"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"}
Jul 23 18:41:07.244258 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.244172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps" event={"ID":"a270bf6a-5f13-4f4c-9d09-44a0a49aeaac","Type":"ContainerDied","Data":"3a2324800cd469919f5b6491ca71a9b88c1303053a26ddc4919af5093ff91dbd"}
Jul 23 18:41:07.244258 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.244194    2579 scope.go:117] "RemoveContainer" containerID="835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"
Jul 23 18:41:07.253295 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.253275    2579 scope.go:117] "RemoveContainer" containerID="835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"
Jul 23 18:41:07.253558 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:41:07.253541    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8\": container with ID starting with 835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8 not found: ID does not exist" containerID="835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"
Jul 23 18:41:07.253621 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.253570    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8"} err="failed to get container status \"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8\": rpc error: code = NotFound desc = could not find container \"835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8\": container with ID starting with 835ff202d2acb98101c7605904b15aa01df5cc7f053f2d30323f708a57067ea8 not found: ID does not exist"
Jul 23 18:41:07.269430 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.269398    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:41:07.274629 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.274607    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-368d7465/e2e-lifecycle-model-368d7465-kserve-679d79844c-zrwps"]
Jul 23 18:41:07.282389 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.282372    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:07.282460 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.282400    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w222f\" (UniqueName: \"kubernetes.io/projected/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-kube-api-access-w222f\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:07.282460 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:07.282410    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:41:08.746501 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:08.746469    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" path="/var/lib/kubelet/pods/a270bf6a-5f13-4f4c-9d09-44a0a49aeaac/volumes"
Jul 23 18:41:30.801394 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:30.801361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:41:30.806679 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:30.806636    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:41:41.085841 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:41.085806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:41:52.625497 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:41:52.625465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:42:46.481509 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:42:46.481429    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:42:55.984519 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:42:55.984483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:43:06.205081 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.205044    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:43:06.205448 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.205433    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerName="main"
Jul 23 18:43:06.205448 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.205445    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerName="main"
Jul 23 18:43:06.205538 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.205527    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a270bf6a-5f13-4f4c-9d09-44a0a49aeaac" containerName="main"
Jul 23 18:43:06.208473 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.208459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.212881 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.212853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-47f36d\"/\"test-model-47f36d-kserve-self-signed-certs\""
Jul 23 18:43:06.212881 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.212863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-47f36d\"/\"default-dockercfg-kn9lw\""
Jul 23 18:43:06.213074 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.212892    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-47f36d\"/\"kube-root-ca.crt\""
Jul 23 18:43:06.213074 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.212892    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-47f36d\"/\"openshift-service-ca.crt\""
Jul 23 18:43:06.235096 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.235072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:43:06.381227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.381227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.381446 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssvm\" (UniqueName: \"kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.381446 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.381446 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.381446 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.381435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482450 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482450 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482450 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssvm\" (UniqueName: \"kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482696 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482696 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482696 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.482958 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.483067 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.482961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.483067 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.483028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.484982 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.484956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.485151 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.485134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.493694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.493670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssvm\" (UniqueName: \"kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm\") pod \"test-model-47f36d-kserve-74bf977f6f-8z4zv\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") " pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.518513 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.518492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:06.655432 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.655407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:43:06.657239 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:43:06.657214    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd432c648_9b49_4716_b4d2_55f5f0f92f53.slice/crio-c403bbfc8473f721e41f0ea3a2f6e6fd478f470ccd727f8215bc1e0455ecca25 WatchSource:0}: Error finding container c403bbfc8473f721e41f0ea3a2f6e6fd478f470ccd727f8215bc1e0455ecca25: Status 404 returned error can't find the container with id c403bbfc8473f721e41f0ea3a2f6e6fd478f470ccd727f8215bc1e0455ecca25
Jul 23 18:43:06.793871 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.793795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" event={"ID":"d432c648-9b49-4716-b4d2-55f5f0f92f53","Type":"ContainerStarted","Data":"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"}
Jul 23 18:43:06.793871 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.793834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" event={"ID":"d432c648-9b49-4716-b4d2-55f5f0f92f53","Type":"ContainerStarted","Data":"c403bbfc8473f721e41f0ea3a2f6e6fd478f470ccd727f8215bc1e0455ecca25"}
Jul 23 18:43:06.817760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:06.817716    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" podStartSLOduration=0.817700272 podStartE2EDuration="817.700272ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:06.815935547 +0000 UTC m=+2196.545368076" watchObservedRunningTime="2026-07-23 18:43:06.817700272 +0000 UTC m=+2196.547132792"
Jul 23 18:43:11.987685 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:11.987650    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:43:16.519390 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:16.519358    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:16.519390 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:16.519400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:16.531988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:16.531961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:16.850352 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:16.850322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:43:35.693227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.693195    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:43:35.696658 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.696634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.700189 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.700153    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d06db7\"/\"test-model-d06db7-kserve-self-signed-certs\""
Jul 23 18:43:35.700322 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.700205    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d06db7\"/\"openshift-service-ca.crt\""
Jul 23 18:43:35.700322 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.700251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d06db7\"/\"kube-root-ca.crt\""
Jul 23 18:43:35.700322 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.700268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d06db7\"/\"default-dockercfg-dmm8t\""
Jul 23 18:43:35.707348 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.707326    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:43:35.819054 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.819170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.819170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.819170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.819170 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvw6\" (UniqueName: \"kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.819307 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.819231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920304 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920399 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920399 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920399 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920541 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvw6\" (UniqueName: \"kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920833 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920804    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.920922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.920873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.922863 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.922834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.923140 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.923122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:35.930621 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:35.930597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvw6\" (UniqueName: \"kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6\") pod \"test-model-d06db7-kserve-5fdb4c7fc9-6fjpn\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") " pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:36.006666 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:36.006608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:36.140677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:36.140635    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:43:36.147859 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:43:36.147827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1f2290_1221_4827_b347_0b3ba0c80604.slice/crio-0bcd857ec285fa5c8adf1016f026e24a1dfcb6cda3e7d0222a9e7686e17b1664 WatchSource:0}: Error finding container 0bcd857ec285fa5c8adf1016f026e24a1dfcb6cda3e7d0222a9e7686e17b1664: Status 404 returned error can't find the container with id 0bcd857ec285fa5c8adf1016f026e24a1dfcb6cda3e7d0222a9e7686e17b1664
Jul 23 18:43:36.935967 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:36.935925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" event={"ID":"2c1f2290-1221-4827-b347-0b3ba0c80604","Type":"ContainerStarted","Data":"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"}
Jul 23 18:43:36.936347 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:36.935974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" event={"ID":"2c1f2290-1221-4827-b347-0b3ba0c80604","Type":"ContainerStarted","Data":"0bcd857ec285fa5c8adf1016f026e24a1dfcb6cda3e7d0222a9e7686e17b1664"}
Jul 23 18:43:36.960094 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:36.960048    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" podStartSLOduration=1.960033375 podStartE2EDuration="1.960033375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:36.9580072 +0000 UTC m=+2226.687439718" watchObservedRunningTime="2026-07-23 18:43:36.960033375 +0000 UTC m=+2226.689465893"
Jul 23 18:43:39.995403 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:39.995362    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:43:46.007039 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:46.007012    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:46.007475 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:46.007070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:46.019619 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:46.019595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:46.992385 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:46.992356    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:43:54.083155 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:43:54.083069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:44:17.388212 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:17.388175    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:44:18.373993 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:18.373964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:44:24.292185 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:24.292151    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:44:32.409156 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.409096    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" podUID="d432c648-9b49-4716-b4d2-55f5f0f92f53" containerName="main" containerID="cri-o://14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360" gracePeriod=45
Jul 23 18:44:32.659355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.659295    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:44:32.801011 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.800980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pssvm\" (UniqueName: \"kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801166 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801018    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801166 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801166 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801302    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm\") pod \"d432c648-9b49-4716-b4d2-55f5f0f92f53\" (UID: \"d432c648-9b49-4716-b4d2-55f5f0f92f53\") "
Jul 23 18:44:32.801345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801329    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache" (OuterVolumeSpecName: "model-cache") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:32.801507 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:32.801507 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801469    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home" (OuterVolumeSpecName: "home") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:32.801650 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801626    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:32.801711 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801656    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:32.801711 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.801670    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:32.803443 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.803417    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm" (OuterVolumeSpecName: "dshm") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:32.803550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.803480    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm" (OuterVolumeSpecName: "kube-api-access-pssvm") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "kube-api-access-pssvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:32.803550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.803486    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d432c648-9b49-4716-b4d2-55f5f0f92f53" (UID: "d432c648-9b49-4716-b4d2-55f5f0f92f53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:44:32.902584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.902559    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d432c648-9b49-4716-b4d2-55f5f0f92f53-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:32.902584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.902585    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pssvm\" (UniqueName: \"kubernetes.io/projected/d432c648-9b49-4716-b4d2-55f5f0f92f53-kube-api-access-pssvm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:32.902725 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:32.902596    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d432c648-9b49-4716-b4d2-55f5f0f92f53-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.206888 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.206855    2579 generic.go:356] "Generic (PLEG): container finished" podID="d432c648-9b49-4716-b4d2-55f5f0f92f53" containerID="14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360" exitCode=0
Jul 23 18:44:33.207056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.206901    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"
Jul 23 18:44:33.207056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.206943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" event={"ID":"d432c648-9b49-4716-b4d2-55f5f0f92f53","Type":"ContainerDied","Data":"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"}
Jul 23 18:44:33.207056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.206986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv" event={"ID":"d432c648-9b49-4716-b4d2-55f5f0f92f53","Type":"ContainerDied","Data":"c403bbfc8473f721e41f0ea3a2f6e6fd478f470ccd727f8215bc1e0455ecca25"}
Jul 23 18:44:33.207056 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.207009    2579 scope.go:117] "RemoveContainer" containerID="14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"
Jul 23 18:44:33.223692 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.223670    2579 scope.go:117] "RemoveContainer" containerID="14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"
Jul 23 18:44:33.223966 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:44:33.223945    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360\": container with ID starting with 14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360 not found: ID does not exist" containerID="14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"
Jul 23 18:44:33.224044 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.223975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360"} err="failed to get container status \"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360\": rpc error: code = NotFound desc = could not find container \"14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360\": container with ID starting with 14c87fc8a314aaa155c5480eb0709f0f60269696d206ec6f4bc4d23a95ed2360 not found: ID does not exist"
Jul 23 18:44:33.235638 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.235613    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:44:33.239523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.239497    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-47f36d/test-model-47f36d-kserve-74bf977f6f-8z4zv"]
Jul 23 18:44:33.394365 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.394323    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" podUID="2c1f2290-1221-4827-b347-0b3ba0c80604" containerName="main" containerID="cri-o://3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159" gracePeriod=45
Jul 23 18:44:33.651294 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.651272    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:44:33.709493 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709641 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709641 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709641 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709641 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvw6\" (UniqueName: \"kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709680    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache\") pod \"2c1f2290-1221-4827-b347-0b3ba0c80604\" (UID: \"2c1f2290-1221-4827-b347-0b3ba0c80604\") "
Jul 23 18:44:33.709884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709832    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home" (OuterVolumeSpecName: "home") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:33.709884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.709858    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:33.710043 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.710022    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:33.710131 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.710114    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.710203 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.710163    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.710203 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.710180    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.711910 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.711888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm" (OuterVolumeSpecName: "dshm") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:33.711910 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.711894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:44:33.712007 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.711968    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6" (OuterVolumeSpecName: "kube-api-access-tfvw6") pod "2c1f2290-1221-4827-b347-0b3ba0c80604" (UID: "2c1f2290-1221-4827-b347-0b3ba0c80604"). InnerVolumeSpecName "kube-api-access-tfvw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:33.811864 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.811766    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c1f2290-1221-4827-b347-0b3ba0c80604-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.811864 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.811824    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c1f2290-1221-4827-b347-0b3ba0c80604-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:33.811864 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:33.811840    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvw6\" (UniqueName: \"kubernetes.io/projected/2c1f2290-1221-4827-b347-0b3ba0c80604-kube-api-access-tfvw6\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:34.213431 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.213355    2579 generic.go:356] "Generic (PLEG): container finished" podID="2c1f2290-1221-4827-b347-0b3ba0c80604" containerID="3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159" exitCode=0
Jul 23 18:44:34.213431 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.213402    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"
Jul 23 18:44:34.213610 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.213445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" event={"ID":"2c1f2290-1221-4827-b347-0b3ba0c80604","Type":"ContainerDied","Data":"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"}
Jul 23 18:44:34.213610 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.213490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn" event={"ID":"2c1f2290-1221-4827-b347-0b3ba0c80604","Type":"ContainerDied","Data":"0bcd857ec285fa5c8adf1016f026e24a1dfcb6cda3e7d0222a9e7686e17b1664"}
Jul 23 18:44:34.213610 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.213511    2579 scope.go:117] "RemoveContainer" containerID="3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"
Jul 23 18:44:34.222730 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.222713    2579 scope.go:117] "RemoveContainer" containerID="3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"
Jul 23 18:44:34.223004 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:44:34.222985    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159\": container with ID starting with 3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159 not found: ID does not exist" containerID="3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"
Jul 23 18:44:34.223066 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.223013    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159"} err="failed to get container status \"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159\": rpc error: code = NotFound desc = could not find container \"3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159\": container with ID starting with 3bf796bfefd573c53e064ac5285caeacaeb8b0c9ab9193a2b6163a87e7b70159 not found: ID does not exist"
Jul 23 18:44:34.240795 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.240759    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:44:34.245010 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.244989    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d06db7/test-model-d06db7-kserve-5fdb4c7fc9-6fjpn"]
Jul 23 18:44:34.685627 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.685595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:44:34.747524 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.747495    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1f2290-1221-4827-b347-0b3ba0c80604" path="/var/lib/kubelet/pods/2c1f2290-1221-4827-b347-0b3ba0c80604/volumes"
Jul 23 18:44:34.747909 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:34.747895    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d432c648-9b49-4716-b4d2-55f5f0f92f53" path="/var/lib/kubelet/pods/d432c648-9b49-4716-b4d2-55f5f0f92f53/volumes"
Jul 23 18:44:41.243937 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.243894    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"]
Jul 23 18:44:41.244530 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244510    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1f2290-1221-4827-b347-0b3ba0c80604" containerName="main"
Jul 23 18:44:41.244600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244533    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1f2290-1221-4827-b347-0b3ba0c80604" containerName="main"
Jul 23 18:44:41.244600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244560    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d432c648-9b49-4716-b4d2-55f5f0f92f53" containerName="main"
Jul 23 18:44:41.244600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244571    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d432c648-9b49-4716-b4d2-55f5f0f92f53" containerName="main"
Jul 23 18:44:41.244694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244658    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1f2290-1221-4827-b347-0b3ba0c80604" containerName="main"
Jul 23 18:44:41.244694 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.244672    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d432c648-9b49-4716-b4d2-55f5f0f92f53" containerName="main"
Jul 23 18:44:41.249178 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.249155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:41.251485 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.251459    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\""
Jul 23 18:44:41.251485 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.251473    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:44:41.255154 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.255097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"]
Jul 23 18:44:41.370535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.370506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79\" (UID: \"2d679326-4e31-4de6-a7a5-baad599e9269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:41.470999 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.470976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79\" (UID: \"2d679326-4e31-4de6-a7a5-baad599e9269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:41.471541 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.471522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79\" (UID: \"2d679326-4e31-4de6-a7a5-baad599e9269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:41.564218 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.564194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:41.909299 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.909224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"]
Jul 23 18:44:41.911954 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:44:41.911933    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d679326_4e31_4de6_a7a5_baad599e9269.slice/crio-74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035 WatchSource:0}: Error finding container 74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035: Status 404 returned error can't find the container with id 74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035
Jul 23 18:44:41.913668 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:41.913651    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:44:42.254416 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:42.254341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79" event={"ID":"2d679326-4e31-4de6-a7a5-baad599e9269","Type":"ContainerStarted","Data":"74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035"}
Jul 23 18:44:53.305421 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:53.305385    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d679326-4e31-4de6-a7a5-baad599e9269" containerID="1e2772c28b64d204efc7f598fbf3c03ffc52427064b8b94fd1dc210c870b6dd2" exitCode=0
Jul 23 18:44:53.305862 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:53.305459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79" event={"ID":"2d679326-4e31-4de6-a7a5-baad599e9269","Type":"ContainerDied","Data":"1e2772c28b64d204efc7f598fbf3c03ffc52427064b8b94fd1dc210c870b6dd2"}
Jul 23 18:44:54.444527 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:54.444504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:54.578992 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:54.578915    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca\") pod \"2d679326-4e31-4de6-a7a5-baad599e9269\" (UID: \"2d679326-4e31-4de6-a7a5-baad599e9269\") "
Jul 23 18:44:54.579244 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:54.579221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d679326-4e31-4de6-a7a5-baad599e9269" (UID: "2d679326-4e31-4de6-a7a5-baad599e9269"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:44:54.680498 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:54.680462    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d679326-4e31-4de6-a7a5-baad599e9269-maas-api-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:44:55.316493 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:55.316466    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"
Jul 23 18:44:55.316676 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:55.316510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79" event={"ID":"2d679326-4e31-4de6-a7a5-baad599e9269","Type":"ContainerDied","Data":"74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035"}
Jul 23 18:44:55.316676 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:44:55.316565    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74f6e7b4a0188fd221183133bf9c9bf5981d9d72d611da78727e367a1bd0a035"
Jul 23 18:45:05.094986 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:05.094953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:45:06.390680 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:06.390646    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"]
Jul 23 18:45:06.395293 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:06.395269    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d06db7-hpd79"]
Jul 23 18:45:06.746496 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:06.746418    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d679326-4e31-4de6-a7a5-baad599e9269" path="/var/lib/kubelet/pods/2d679326-4e31-4de6-a7a5-baad599e9269/volumes"
Jul 23 18:45:23.694640 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:23.694549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:45:39.007677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.007645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:45:39.947724 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.947690    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"]
Jul 23 18:45:39.948062 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.948050    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d679326-4e31-4de6-a7a5-baad599e9269" containerName="revoke-keys"
Jul 23 18:45:39.948108 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.948064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d679326-4e31-4de6-a7a5-baad599e9269" containerName="revoke-keys"
Jul 23 18:45:39.948145 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.948141    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d679326-4e31-4de6-a7a5-baad599e9269" containerName="revoke-keys"
Jul 23 18:45:39.951270 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.951255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:39.954873 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:45:39.954842    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-api-cleanup-dockercfg-4sxmg\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\"" type="*v1.Secret"
Jul 23 18:45:39.954873 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:45:39.954860    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 23 18:45:39.955072 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:45:39.954858    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="272ce315-e699-4097-bc2b-2ab83abb3d8e" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:39.964761 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:39.964733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"]
Jul 23 18:45:40.058135 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:40.058109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8\" (UID: \"272ce315-e699-4097-bc2b-2ab83abb3d8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:40.159384 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:40.159353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8\" (UID: \"272ce315-e699-4097-bc2b-2ab83abb3d8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:40.906487 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:40.906457    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:45:40.911014 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:40.910995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8\" (UID: \"272ce315-e699-4097-bc2b-2ab83abb3d8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:41.207319 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:41.207249    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\""
Jul 23 18:45:41.212430 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:41.212404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:41.360212 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:41.360177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"]
Jul 23 18:45:41.362527 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:45:41.362493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272ce315_e699_4097_bc2b_2ab83abb3d8e.slice/crio-bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba WatchSource:0}: Error finding container bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba: Status 404 returned error can't find the container with id bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba
Jul 23 18:45:41.542581 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:41.542527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8" event={"ID":"272ce315-e699-4097-bc2b-2ab83abb3d8e","Type":"ContainerStarted","Data":"bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba"}
Jul 23 18:45:42.554837 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:42.554800    2579 generic.go:356] "Generic (PLEG): container finished" podID="272ce315-e699-4097-bc2b-2ab83abb3d8e" containerID="b0b2981e1334976acbb202e02bfafbc45d16fd47c48d53a8f567cbe2233d4f29" exitCode=0
Jul 23 18:45:42.555194 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:42.554883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8" event={"ID":"272ce315-e699-4097-bc2b-2ab83abb3d8e","Type":"ContainerDied","Data":"b0b2981e1334976acbb202e02bfafbc45d16fd47c48d53a8f567cbe2233d4f29"}
Jul 23 18:45:43.691201 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:43.691178    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:43.791083 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:43.791057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca\") pod \"272ce315-e699-4097-bc2b-2ab83abb3d8e\" (UID: \"272ce315-e699-4097-bc2b-2ab83abb3d8e\") "
Jul 23 18:45:43.791356 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:43.791336    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "272ce315-e699-4097-bc2b-2ab83abb3d8e" (UID: "272ce315-e699-4097-bc2b-2ab83abb3d8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:45:43.893368 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:43.893281    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/272ce315-e699-4097-bc2b-2ab83abb3d8e-maas-api-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:45:44.565407 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:44.565373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8" event={"ID":"272ce315-e699-4097-bc2b-2ab83abb3d8e","Type":"ContainerDied","Data":"bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba"}
Jul 23 18:45:44.565568 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:44.565421    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf1fdf944a871d3372d508190e471bcd1399dc6bea947c0fff497193f6f18dba"
Jul 23 18:45:44.565568 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:44.565390    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"
Jul 23 18:45:59.303192 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:45:59.303156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:46:00.050732 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:00.050690    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"]
Jul 23 18:46:00.054666 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:00.054643    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dc11fe-6d5c8"]
Jul 23 18:46:00.746980 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:00.746946    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="272ce315-e699-4097-bc2b-2ab83abb3d8e" path="/var/lib/kubelet/pods/272ce315-e699-4097-bc2b-2ab83abb3d8e/volumes"
Jul 23 18:46:07.855104 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.855070    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"]
Jul 23 18:46:07.855481 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.855421    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="272ce315-e699-4097-bc2b-2ab83abb3d8e" containerName="revoke-keys"
Jul 23 18:46:07.855481 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.855432    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="272ce315-e699-4097-bc2b-2ab83abb3d8e" containerName="revoke-keys"
Jul 23 18:46:07.855550 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.855498    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="272ce315-e699-4097-bc2b-2ab83abb3d8e" containerName="revoke-keys"
Jul 23 18:46:07.858693 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.858677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:07.861531 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.861512    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:46:07.861684 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.861667    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\""
Jul 23 18:46:07.875520 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:07.875497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"]
Jul 23 18:46:08.001584 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.001547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz\" (UID: \"08a1c859-4e6f-4155-84ca-e42a6d66a7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:08.102296 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.102261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz\" (UID: \"08a1c859-4e6f-4155-84ca-e42a6d66a7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:08.102921 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.102898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz\" (UID: \"08a1c859-4e6f-4155-84ca-e42a6d66a7cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:08.168178 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.168114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:08.304560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.304535    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"]
Jul 23 18:46:08.307117 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:46:08.307081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a1c859_4e6f_4155_84ca_e42a6d66a7cd.slice/crio-680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e WatchSource:0}: Error finding container 680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e: Status 404 returned error can't find the container with id 680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e
Jul 23 18:46:08.683873 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.683838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz" event={"ID":"08a1c859-4e6f-4155-84ca-e42a6d66a7cd","Type":"ContainerStarted","Data":"1f971a74d983b408adced4992cb3634fbf8ac6b5748538956a19d4bbddbc1873"}
Jul 23 18:46:08.684008 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.683902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz" event={"ID":"08a1c859-4e6f-4155-84ca-e42a6d66a7cd","Type":"ContainerStarted","Data":"680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e"}
Jul 23 18:46:08.707645 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:08.707601    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz" podStartSLOduration=1.7075876559999998 podStartE2EDuration="1.707587656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:08.70605567 +0000 UTC m=+2378.435488188" watchObservedRunningTime="2026-07-23 18:46:08.707587656 +0000 UTC m=+2378.437020174"
Jul 23 18:46:09.690602 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:09.690568    2579 generic.go:356] "Generic (PLEG): container finished" podID="08a1c859-4e6f-4155-84ca-e42a6d66a7cd" containerID="1f971a74d983b408adced4992cb3634fbf8ac6b5748538956a19d4bbddbc1873" exitCode=0
Jul 23 18:46:09.690995 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:09.690656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz" event={"ID":"08a1c859-4e6f-4155-84ca-e42a6d66a7cd","Type":"ContainerDied","Data":"1f971a74d983b408adced4992cb3634fbf8ac6b5748538956a19d4bbddbc1873"}
Jul 23 18:46:10.828193 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:10.828172    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:10.921600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:10.921576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca\") pod \"08a1c859-4e6f-4155-84ca-e42a6d66a7cd\" (UID: \"08a1c859-4e6f-4155-84ca-e42a6d66a7cd\") "
Jul 23 18:46:10.921940 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:10.921919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "08a1c859-4e6f-4155-84ca-e42a6d66a7cd" (UID: "08a1c859-4e6f-4155-84ca-e42a6d66a7cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:46:11.022087 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:11.022035    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/08a1c859-4e6f-4155-84ca-e42a6d66a7cd-maas-api-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:46:11.700754 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:11.700725    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"
Jul 23 18:46:11.700925 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:11.700753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz" event={"ID":"08a1c859-4e6f-4155-84ca-e42a6d66a7cd","Type":"ContainerDied","Data":"680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e"}
Jul 23 18:46:11.700925 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:11.700820    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="680b7693909b78aaeb9fe10f204a5acf1d42cc471c6b551e16cbda7da1ae562e"
Jul 23 18:46:28.071471 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:28.071431    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"]
Jul 23 18:46:28.077803 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:28.077760    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-81e4dc-rwgmz"]
Jul 23 18:46:28.707142 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:28.707102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:46:28.746636 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:28.746604    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08a1c859-4e6f-4155-84ca-e42a6d66a7cd" path="/var/lib/kubelet/pods/08a1c859-4e6f-4155-84ca-e42a6d66a7cd/volumes"
Jul 23 18:46:30.830596 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:30.830558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:46:30.836585 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:30.836564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:46:47.389811 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:47.389760    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:46:59.797905 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:46:59.797829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:47:02.184877 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.184842    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:47:02.185452 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.185208    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a1c859-4e6f-4155-84ca-e42a6d66a7cd" containerName="revoke-keys"
Jul 23 18:47:02.185452 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.185219    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a1c859-4e6f-4155-84ca-e42a6d66a7cd" containerName="revoke-keys"
Jul 23 18:47:02.185452 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.185282    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a1c859-4e6f-4155-84ca-e42a6d66a7cd" containerName="revoke-keys"
Jul 23 18:47:02.188423 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.188402    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.191556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.191533    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"kube-root-ca.crt\""
Jul 23 18:47:02.191556 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.191560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"openshift-service-ca.crt\""
Jul 23 18:47:02.191759 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.191584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"default-dockercfg-8rxbv\""
Jul 23 18:47:02.191759 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.191539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"auth-test-model-718e88-kserve-self-signed-certs\""
Jul 23 18:47:02.198211 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.198191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:47:02.346292 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.346406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.346406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8g2\" (UniqueName: \"kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.346406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.346406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.346577 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.346415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447594 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447594 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8g2\" (UniqueName: \"kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447594 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447804 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447869 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.447943 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.447922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.449894 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.449872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.450115 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.450099    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.456520 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.456499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8g2\" (UniqueName: \"kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2\") pod \"auth-test-model-718e88-kserve-5d6879ccdc-7f76c\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") " pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.498186 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.498164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:02.636187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.636161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:47:02.638269 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:47:02.638240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9756413_ec28_4e57_9d83_19e375ef9fac.slice/crio-fa433bdb929fbd5c0742cea588df560d8163fbeb1d3e5baf2f62fc0c5d63ec6c WatchSource:0}: Error finding container fa433bdb929fbd5c0742cea588df560d8163fbeb1d3e5baf2f62fc0c5d63ec6c: Status 404 returned error can't find the container with id fa433bdb929fbd5c0742cea588df560d8163fbeb1d3e5baf2f62fc0c5d63ec6c
Jul 23 18:47:02.941824 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.941755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" event={"ID":"a9756413-ec28-4e57-9d83-19e375ef9fac","Type":"ContainerStarted","Data":"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"}
Jul 23 18:47:02.941988 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.941835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" event={"ID":"a9756413-ec28-4e57-9d83-19e375ef9fac","Type":"ContainerStarted","Data":"fa433bdb929fbd5c0742cea588df560d8163fbeb1d3e5baf2f62fc0c5d63ec6c"}
Jul 23 18:47:02.972889 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:02.972837    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" podStartSLOduration=0.972821638 podStartE2EDuration="972.821638ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:47:02.971623344 +0000 UTC m=+2432.701055865" watchObservedRunningTime="2026-07-23 18:47:02.972821638 +0000 UTC m=+2432.702254156"
Jul 23 18:47:12.498440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:12.498402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:12.498440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:12.498449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:12.511012 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:12.510986    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:13.001198 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:13.001168    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:47:13.680998 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:13.680964    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:47:21.272587 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.272554    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:47:21.276187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.276168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.278353 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.278329    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"kube-root-ca.crt\""
Jul 23 18:47:21.278478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.278425    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"openshift-service-ca.crt\""
Jul 23 18:47:21.279341 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.279325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"auth-test-model-2fc9f5-kserve-self-signed-certs\""
Jul 23 18:47:21.279403 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.279328    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"default-dockercfg-l4q97\""
Jul 23 18:47:21.285847 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.285770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:47:21.301165 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.301289 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.301289 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7h5\" (UniqueName: \"kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.301409 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.301409 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.301409 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.301354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402428 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402547 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402590 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7h5\" (UniqueName: \"kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402656 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402743 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402743 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.402872 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.402855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.403077 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.403056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.403149 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.403084    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.404929 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.404905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.405205 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.405187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.412796 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.412760    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7h5\" (UniqueName: \"kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5\") pod \"auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") " pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.586884 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.586858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:21.721596 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:21.721566    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:47:21.724936 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:47:21.724907    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod896b5405_5617_41c8_84ee_93cadc0a487e.slice/crio-e13f6043c0a76d235db7dd154efca4db25d8ae45a766e968f9a5e636fe5b64a0 WatchSource:0}: Error finding container e13f6043c0a76d235db7dd154efca4db25d8ae45a766e968f9a5e636fe5b64a0: Status 404 returned error can't find the container with id e13f6043c0a76d235db7dd154efca4db25d8ae45a766e968f9a5e636fe5b64a0
Jul 23 18:47:22.034367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:22.034285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" event={"ID":"896b5405-5617-41c8-84ee-93cadc0a487e","Type":"ContainerStarted","Data":"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"}
Jul 23 18:47:22.034367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:22.034332    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" event={"ID":"896b5405-5617-41c8-84ee-93cadc0a487e","Type":"ContainerStarted","Data":"e13f6043c0a76d235db7dd154efca4db25d8ae45a766e968f9a5e636fe5b64a0"}
Jul 23 18:47:22.052900 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:22.052853    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" podStartSLOduration=1.052837948 podStartE2EDuration="1.052837948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:47:22.051815135 +0000 UTC m=+2451.781247650" watchObservedRunningTime="2026-07-23 18:47:22.052837948 +0000 UTC m=+2451.782270466"
Jul 23 18:47:25.982822 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:25.982771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:47:31.587030 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:31.586995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:31.587429 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:31.587048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:31.599314 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:31.599293    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:32.092244 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:32.092215    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:47:39.986455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:39.986414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:47:57.284995 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:47:57.284959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:48:13.880970 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:48:13.880939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:48:32.086954 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:48:32.086865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:48:50.884096 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:48:50.884060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:49:11.184255 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:11.184221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:49:26.096071 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:26.096037    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:49:27.169611 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:27.169576    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:49:31.085421 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:31.085388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:49:41.116711 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.116647    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" podUID="a9756413-ec28-4e57-9d83-19e375ef9fac" containerName="main" containerID="cri-o://046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26" gracePeriod=45
Jul 23 18:49:41.369603 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.369552    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:49:41.486636 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.486826 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw8g2\" (UniqueName: \"kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.486826 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.486826 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.487012 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:41.487012 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.486938    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.487118 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487052    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache\") pod \"a9756413-ec28-4e57-9d83-19e375ef9fac\" (UID: \"a9756413-ec28-4e57-9d83-19e375ef9fac\") "
Jul 23 18:49:41.487118 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home" (OuterVolumeSpecName: "home") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:41.487289 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487268    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:41.487396 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487382    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.487449 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487400    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.487449 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.487416    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.489304 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.489283    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2" (OuterVolumeSpecName: "kube-api-access-dw8g2") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "kube-api-access-dw8g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:41.489466 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.489446    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm" (OuterVolumeSpecName: "dshm") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:41.489524 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.489465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9756413-ec28-4e57-9d83-19e375ef9fac" (UID: "a9756413-ec28-4e57-9d83-19e375ef9fac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:49:41.588233 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.588210    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw8g2\" (UniqueName: \"kubernetes.io/projected/a9756413-ec28-4e57-9d83-19e375ef9fac-kube-api-access-dw8g2\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.588233 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.588231    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9756413-ec28-4e57-9d83-19e375ef9fac-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.588362 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.588240    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9756413-ec28-4e57-9d83-19e375ef9fac-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:41.723055 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.722957    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9756413-ec28-4e57-9d83-19e375ef9fac" containerID="046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26" exitCode=0
Jul 23 18:49:41.723055 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.723004    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"
Jul 23 18:49:41.723055 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.723040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" event={"ID":"a9756413-ec28-4e57-9d83-19e375ef9fac","Type":"ContainerDied","Data":"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"}
Jul 23 18:49:41.723317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.723082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c" event={"ID":"a9756413-ec28-4e57-9d83-19e375ef9fac","Type":"ContainerDied","Data":"fa433bdb929fbd5c0742cea588df560d8163fbeb1d3e5baf2f62fc0c5d63ec6c"}
Jul 23 18:49:41.723317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.723099    2579 scope.go:117] "RemoveContainer" containerID="046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"
Jul 23 18:49:41.732220 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.732206    2579 scope.go:117] "RemoveContainer" containerID="046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"
Jul 23 18:49:41.732440 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:49:41.732419    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26\": container with ID starting with 046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26 not found: ID does not exist" containerID="046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"
Jul 23 18:49:41.732503 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.732451    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26"} err="failed to get container status \"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26\": rpc error: code = NotFound desc = could not find container \"046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26\": container with ID starting with 046cdd9df4b50ab1af8521011855dbc221b69b7db46bb1e017db4623310d4f26 not found: ID does not exist"
Jul 23 18:49:41.746116 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.746089    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:49:41.749022 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:41.749001    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/auth-test-model-718e88-kserve-5d6879ccdc-7f76c"]
Jul 23 18:49:42.190560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.190527    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" podUID="896b5405-5617-41c8-84ee-93cadc0a487e" containerName="main" containerID="cri-o://eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666" gracePeriod=45
Jul 23 18:49:42.447757 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.447706    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:49:42.598127 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598086    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598127 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598133    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc7h5\" (UniqueName: \"kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598201    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598260    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs\") pod \"896b5405-5617-41c8-84ee-93cadc0a487e\" (UID: \"896b5405-5617-41c8-84ee-93cadc0a487e\") "
Jul 23 18:49:42.598559 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache" (OuterVolumeSpecName: "model-cache") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:42.598559 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598506    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home" (OuterVolumeSpecName: "home") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:42.598559 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.598526    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:42.600564 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.600538    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm" (OuterVolumeSpecName: "dshm") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:49:42.600674 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.600578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:49:42.600674 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.600584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5" (OuterVolumeSpecName: "kube-api-access-cc7h5") pod "896b5405-5617-41c8-84ee-93cadc0a487e" (UID: "896b5405-5617-41c8-84ee-93cadc0a487e"). InnerVolumeSpecName "kube-api-access-cc7h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699186    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699218    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699227    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699235    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/896b5405-5617-41c8-84ee-93cadc0a487e-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699241    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/896b5405-5617-41c8-84ee-93cadc0a487e-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.699253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.699249    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc7h5\" (UniqueName: \"kubernetes.io/projected/896b5405-5617-41c8-84ee-93cadc0a487e-kube-api-access-cc7h5\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:49:42.729000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.728969    2579 generic.go:356] "Generic (PLEG): container finished" podID="896b5405-5617-41c8-84ee-93cadc0a487e" containerID="eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666" exitCode=0
Jul 23 18:49:42.729093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.729020    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"
Jul 23 18:49:42.729093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.729057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" event={"ID":"896b5405-5617-41c8-84ee-93cadc0a487e","Type":"ContainerDied","Data":"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"}
Jul 23 18:49:42.729168 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.729097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg" event={"ID":"896b5405-5617-41c8-84ee-93cadc0a487e","Type":"ContainerDied","Data":"e13f6043c0a76d235db7dd154efca4db25d8ae45a766e968f9a5e636fe5b64a0"}
Jul 23 18:49:42.729168 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.729114    2579 scope.go:117] "RemoveContainer" containerID="eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"
Jul 23 18:49:42.737866 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.737851    2579 scope.go:117] "RemoveContainer" containerID="eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"
Jul 23 18:49:42.738103 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:49:42.738084    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666\": container with ID starting with eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666 not found: ID does not exist" containerID="eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"
Jul 23 18:49:42.738160 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.738115    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666"} err="failed to get container status \"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666\": rpc error: code = NotFound desc = could not find container \"eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666\": container with ID starting with eac1797a28c050210fad9520be6e0322ff0aa0450673f68e8305f674439f8666 not found: ID does not exist"
Jul 23 18:49:42.746575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.746551    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9756413-ec28-4e57-9d83-19e375ef9fac" path="/var/lib/kubelet/pods/a9756413-ec28-4e57-9d83-19e375ef9fac/volumes"
Jul 23 18:49:42.752820 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.752802    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:49:42.757692 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:42.757672    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/auth-test-model-2fc9f5-kserve-85fc887f9f-dbswg"]
Jul 23 18:49:44.746938 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:44.746903    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="896b5405-5617-41c8-84ee-93cadc0a487e" path="/var/lib/kubelet/pods/896b5405-5617-41c8-84ee-93cadc0a487e/volumes"
Jul 23 18:49:45.281868 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:49:45.281835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:50:10.688239 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688158    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688539    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9756413-ec28-4e57-9d83-19e375ef9fac" containerName="main"
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688553    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9756413-ec28-4e57-9d83-19e375ef9fac" containerName="main"
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688565    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="896b5405-5617-41c8-84ee-93cadc0a487e" containerName="main"
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688570    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="896b5405-5617-41c8-84ee-93cadc0a487e" containerName="main"
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688651    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9756413-ec28-4e57-9d83-19e375ef9fac" containerName="main"
Jul 23 18:50:10.688677 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.688662    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="896b5405-5617-41c8-84ee-93cadc0a487e" containerName="main"
Jul 23 18:50:10.691288 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.691268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.695666 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.695646    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"openshift-service-ca.crt\""
Jul 23 18:50:10.695666 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.695659    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"sub-test-model-2fc9f5-kserve-self-signed-certs\""
Jul 23 18:50:10.695854 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.695652    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"default-dockercfg-l4q97\""
Jul 23 18:50:10.695854 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.695754    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"kube-root-ca.crt\""
Jul 23 18:50:10.701589 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.701570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:50:10.737129 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.737224 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.737274 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.737274 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.737352 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqc4\" (UniqueName: \"kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.737389 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.737352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838256 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838345 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838452 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838452 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqc4\" (UniqueName: \"kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838546 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838839 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838839 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.838978 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.838858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.840725 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.840704    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.840998 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.840982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:10.851085 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:10.851064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqc4\" (UniqueName: \"kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4\") pod \"sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") " pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:11.001088 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:11.001031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:11.135475 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:11.135449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:50:11.140594 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:50:11.140564    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bc9557d_ade3_4df2_946e_4f36ac71a4a2.slice/crio-34db5be06cd7ac7031bca6bb87fbe28f807b4dc453a69f613779a858d68ae6ac WatchSource:0}: Error finding container 34db5be06cd7ac7031bca6bb87fbe28f807b4dc453a69f613779a858d68ae6ac: Status 404 returned error can't find the container with id 34db5be06cd7ac7031bca6bb87fbe28f807b4dc453a69f613779a858d68ae6ac
Jul 23 18:50:11.865179 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:11.865145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" event={"ID":"8bc9557d-ade3-4df2-946e-4f36ac71a4a2","Type":"ContainerStarted","Data":"f7179f8d70ec7f0340e7c7ea23c47470c92a1175b48636fae3ea648acdd552c0"}
Jul 23 18:50:11.865755 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:11.865188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" event={"ID":"8bc9557d-ade3-4df2-946e-4f36ac71a4a2","Type":"ContainerStarted","Data":"34db5be06cd7ac7031bca6bb87fbe28f807b4dc453a69f613779a858d68ae6ac"}
Jul 23 18:50:11.886680 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:11.886633    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" podStartSLOduration=1.886620218 podStartE2EDuration="1.886620218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:50:11.885331722 +0000 UTC m=+2621.614764242" watchObservedRunningTime="2026-07-23 18:50:11.886620218 +0000 UTC m=+2621.616052714"
Jul 23 18:50:14.883582 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:14.883547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:50:21.002084 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:21.002047    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:21.002440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:21.002104    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:21.014408 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:21.014386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:21.921534 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:21.921507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:50:33.185926 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:33.185882    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:50:51.291624 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:51.291586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:50:57.968622 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:50:57.968587    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:51:06.588405 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.588372    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:51:06.591945 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.591925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.594763 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.594744    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"openshift-service-ca.crt\""
Jul 23 18:51:06.595286 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.595251    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"rate-test-model-718e88-kserve-self-signed-certs\""
Jul 23 18:51:06.595419 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.595401    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"kube-root-ca.crt\""
Jul 23 18:51:06.595498 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.595408    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-718e88\"/\"default-dockercfg-8rxbv\""
Jul 23 18:51:06.603269 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.603249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:51:06.722187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.722357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4jdv\" (UniqueName: \"kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.722357 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.722483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.722483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.722483 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.722416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.822962 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.822934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4jdv\" (UniqueName: \"kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823112 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.822973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823186 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823236 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823281 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823236    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823281 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823346 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823592 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.823703 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.823641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.825467 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.825447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.825750 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.825734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.832155 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.832137    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4jdv\" (UniqueName: \"kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv\") pod \"rate-test-model-718e88-kserve-67c4767fff-42s6s\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") " pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:06.901168 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:06.901104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:07.034918 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:07.034895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:51:07.037637 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:51:07.037610    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbc1b031_4a11_438e_b387_0d50a4ce42ea.slice/crio-e5e2a3a6df5e97a2f1289a88b06d593dcce52ecb69d2f75d17b3514409cc4a81 WatchSource:0}: Error finding container e5e2a3a6df5e97a2f1289a88b06d593dcce52ecb69d2f75d17b3514409cc4a81: Status 404 returned error can't find the container with id e5e2a3a6df5e97a2f1289a88b06d593dcce52ecb69d2f75d17b3514409cc4a81
Jul 23 18:51:07.134394 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:07.134361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" event={"ID":"cbc1b031-4a11-438e-b387-0d50a4ce42ea","Type":"ContainerStarted","Data":"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"}
Jul 23 18:51:07.134525 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:07.134408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" event={"ID":"cbc1b031-4a11-438e-b387-0d50a4ce42ea","Type":"ContainerStarted","Data":"e5e2a3a6df5e97a2f1289a88b06d593dcce52ecb69d2f75d17b3514409cc4a81"}
Jul 23 18:51:07.154935 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:07.154838    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" podStartSLOduration=1.154822972 podStartE2EDuration="1.154822972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:07.153446657 +0000 UTC m=+2676.882879174" watchObservedRunningTime="2026-07-23 18:51:07.154822972 +0000 UTC m=+2676.884255489"
Jul 23 18:51:09.873834 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:09.873800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:51:12.989367 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:12.989306    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" podUID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" containerName="main" containerID="cri-o://f7179f8d70ec7f0340e7c7ea23c47470c92a1175b48636fae3ea648acdd552c0" gracePeriod=45
Jul 23 18:51:13.165845 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.165809    2579 generic.go:356] "Generic (PLEG): container finished" podID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" containerID="f7179f8d70ec7f0340e7c7ea23c47470c92a1175b48636fae3ea648acdd552c0" exitCode=0
Jul 23 18:51:13.165989 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.165889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" event={"ID":"8bc9557d-ade3-4df2-946e-4f36ac71a4a2","Type":"ContainerDied","Data":"f7179f8d70ec7f0340e7c7ea23c47470c92a1175b48636fae3ea648acdd552c0"}
Jul 23 18:51:13.245537 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.245477    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:51:13.377991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.377961    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378171 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378171 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378171 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378098    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckqc4\" (UniqueName: \"kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378353 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378353 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378217    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:13.378353 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home\") pod \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\" (UID: \"8bc9557d-ade3-4df2-946e-4f36ac71a4a2\") "
Jul 23 18:51:13.378353 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:13.378561 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378500    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home" (OuterVolumeSpecName: "home") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:13.378561 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378522    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:13.378561 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.378550    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:13.380275 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.380248    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:51:13.380396 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.380341    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm" (OuterVolumeSpecName: "dshm") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:13.380444 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.380413    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4" (OuterVolumeSpecName: "kube-api-access-ckqc4") pod "8bc9557d-ade3-4df2-946e-4f36ac71a4a2" (UID: "8bc9557d-ade3-4df2-946e-4f36ac71a4a2"). InnerVolumeSpecName "kube-api-access-ckqc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:51:13.479343 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.479324    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:13.479343 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.479343    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:13.479343 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.479353    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckqc4\" (UniqueName: \"kubernetes.io/projected/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-kube-api-access-ckqc4\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:13.479513 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:13.479361    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bc9557d-ade3-4df2-946e-4f36ac71a4a2-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:51:14.172000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.171964    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"
Jul 23 18:51:14.172000 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.171994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt" event={"ID":"8bc9557d-ade3-4df2-946e-4f36ac71a4a2","Type":"ContainerDied","Data":"34db5be06cd7ac7031bca6bb87fbe28f807b4dc453a69f613779a858d68ae6ac"}
Jul 23 18:51:14.172515 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.172037    2579 scope.go:117] "RemoveContainer" containerID="f7179f8d70ec7f0340e7c7ea23c47470c92a1175b48636fae3ea648acdd552c0"
Jul 23 18:51:14.195079 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.195050    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:51:14.201400 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.201379    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/sub-test-model-2fc9f5-kserve-d85b9db6f-dbvtt"]
Jul 23 18:51:14.746721 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:14.746688    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" path="/var/lib/kubelet/pods/8bc9557d-ade3-4df2-946e-4f36ac71a4a2/volumes"
Jul 23 18:51:16.901354 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:16.901317    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:16.901774 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:16.901388    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:16.913586 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:16.913564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:17.198075 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:17.197981    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:51:30.859355 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:30.859280    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:51:30.866576 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:30.866557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:51:30.923716 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:30.923690    2579 scope.go:117] "RemoveContainer" containerID="1e2772c28b64d204efc7f598fbf3c03ffc52427064b8b94fd1dc210c870b6dd2"
Jul 23 18:51:37.982004 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.981973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:51:37.982379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.982354    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" containerName="main"
Jul 23 18:51:37.982379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.982371    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" containerName="main"
Jul 23 18:51:37.982489 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.982447    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc9557d-ade3-4df2-946e-4f36ac71a4a2" containerName="main"
Jul 23 18:51:37.985411 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.985393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:37.988955 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.988927    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"kube-root-ca.crt\""
Jul 23 18:51:37.988955 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.988930    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"default-dockercfg-l4q97\""
Jul 23 18:51:37.989128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.988981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"rate-test-model-2fc9f5-kserve-self-signed-certs\""
Jul 23 18:51:37.989128 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.988954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2fc9f5\"/\"openshift-service-ca.crt\""
Jul 23 18:51:37.996465 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:37.996443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:51:38.087346 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwlq\" (UniqueName: \"kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.087528 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.087528 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.087528 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.087528 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.087691 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.087540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188387 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwlq\" (UniqueName: \"kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188523 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188865 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188947 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.188947 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.188921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.191018 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.190996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.191187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.191170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.198315 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.198295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwlq\" (UniqueName: \"kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq\") pod \"rate-test-model-2fc9f5-kserve-7848d8459-rklgp\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") " pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.295450 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.295370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:38.457933 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:38.457908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:51:38.460173 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:51:38.460150    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e504470_5890_484a_b9cb_16ea04cb63b7.slice/crio-7fa457e69547d3c0b7c051e427fc424907a6e18afa82bdd061dcda99ad72128d WatchSource:0}: Error finding container 7fa457e69547d3c0b7c051e427fc424907a6e18afa82bdd061dcda99ad72128d: Status 404 returned error can't find the container with id 7fa457e69547d3c0b7c051e427fc424907a6e18afa82bdd061dcda99ad72128d
Jul 23 18:51:39.293859 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:39.293822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" event={"ID":"2e504470-5890-484a-b9cb-16ea04cb63b7","Type":"ContainerStarted","Data":"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"}
Jul 23 18:51:39.294234 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:39.293868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" event={"ID":"2e504470-5890-484a-b9cb-16ea04cb63b7","Type":"ContainerStarted","Data":"7fa457e69547d3c0b7c051e427fc424907a6e18afa82bdd061dcda99ad72128d"}
Jul 23 18:51:39.322429 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:39.322388    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" podStartSLOduration=2.322368619 podStartE2EDuration="2.322368619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:51:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:39.32068774 +0000 UTC m=+2709.050120259" watchObservedRunningTime="2026-07-23 18:51:39.322368619 +0000 UTC m=+2709.051801202"
Jul 23 18:51:42.874998 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:42.874964    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:51:48.295869 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:48.295835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:48.296320 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:48.295884    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:48.308426 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:48.308403    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:51:48.347253 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:51:48.347227    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:52:09.487773 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:09.487737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:52:25.076455 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:25.076419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:52:30.944555 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:30.944522    2579 scope.go:117] "RemoveContainer" containerID="1f971a74d983b408adced4992cb3634fbf8ac6b5748538956a19d4bbddbc1873"
Jul 23 18:52:30.952360 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:30.952339    2579 scope.go:117] "RemoveContainer" containerID="b0b2981e1334976acbb202e02bfafbc45d16fd47c48d53a8f567cbe2233d4f29"
Jul 23 18:52:32.147169 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:32.147135    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:52:33.057960 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:33.057926    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:52:45.780406 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:45.780376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:52:47.167238 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.167200    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerName="main" containerID="cri-o://56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76" gracePeriod=45
Jul 23 18:52:47.187548 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.187521    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerName="main" probeResult="failure" output="Get \"https://10.132.0.44:8000/ready\": dial tcp 10.132.0.44:8000: connect: connection refused"
Jul 23 18:52:47.419560 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.419505    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:52:47.571860 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.571829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.571880    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.571914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.571968    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.571985    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572027 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4jdv\" (UniqueName: \"kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv\") pod \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\" (UID: \"cbc1b031-4a11-438e-b387-0d50a4ce42ea\") "
Jul 23 18:52:47.572289 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:47.572289 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:47.572404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572282    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home" (OuterVolumeSpecName: "home") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:47.572404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572361    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:47.572404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572380    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:47.572404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.572394    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:47.574300 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.574275    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:52:47.574539 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.574511    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv" (OuterVolumeSpecName: "kube-api-access-l4jdv") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "kube-api-access-l4jdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:52:47.574539 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.574514    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm" (OuterVolumeSpecName: "dshm") pod "cbc1b031-4a11-438e-b387-0d50a4ce42ea" (UID: "cbc1b031-4a11-438e-b387-0d50a4ce42ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:47.619298 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.619270    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerID="56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76" exitCode=0
Jul 23 18:52:47.619422 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.619332    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"
Jul 23 18:52:47.619422 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.619331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" event={"ID":"cbc1b031-4a11-438e-b387-0d50a4ce42ea","Type":"ContainerDied","Data":"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"}
Jul 23 18:52:47.619422 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.619373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s" event={"ID":"cbc1b031-4a11-438e-b387-0d50a4ce42ea","Type":"ContainerDied","Data":"e5e2a3a6df5e97a2f1289a88b06d593dcce52ecb69d2f75d17b3514409cc4a81"}
Jul 23 18:52:47.619422 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.619395    2579 scope.go:117] "RemoveContainer" containerID="56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"
Jul 23 18:52:47.628874 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.628859    2579 scope.go:117] "RemoveContainer" containerID="56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"
Jul 23 18:52:47.629152 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:52:47.629135    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76\": container with ID starting with 56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76 not found: ID does not exist" containerID="56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"
Jul 23 18:52:47.629222 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.629162    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76"} err="failed to get container status \"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76\": rpc error: code = NotFound desc = could not find container \"56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76\": container with ID starting with 56254715dc432dd7d5ba20a1002088e47b3a6efecb968b6c6ada899d4e119f76 not found: ID does not exist"
Jul 23 18:52:47.642363 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.642342    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:52:47.648262 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.648232    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-718e88/rate-test-model-718e88-kserve-67c4767fff-42s6s"]
Jul 23 18:52:47.673889 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.673840    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc1b031-4a11-438e-b387-0d50a4ce42ea-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:47.673889 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.673860    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc1b031-4a11-438e-b387-0d50a4ce42ea-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:47.673889 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:47.673872    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4jdv\" (UniqueName: \"kubernetes.io/projected/cbc1b031-4a11-438e-b387-0d50a4ce42ea-kube-api-access-l4jdv\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.081385 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.081327    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" podUID="2e504470-5890-484a-b9cb-16ea04cb63b7" containerName="main" containerID="cri-o://f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10" gracePeriod=45
Jul 23 18:52:48.336675 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.336615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:52:48.482070 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482045    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482225 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482206    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpwlq\" (UniqueName: \"kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482442 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482235    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home\") pod \"2e504470-5890-484a-b9cb-16ea04cb63b7\" (UID: \"2e504470-5890-484a-b9cb-16ea04cb63b7\") "
Jul 23 18:52:48.482442 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482342    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:48.482535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482467    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:48.482535 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482495    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home" (OuterVolumeSpecName: "home") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:48.482651 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482569    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-home\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.482651 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482586    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-model-cache\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.482651 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.482595    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-tmp-dir\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.484506 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.484479    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:52:48.484611 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.484557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm" (OuterVolumeSpecName: "dshm") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:52:48.484611 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.484576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq" (OuterVolumeSpecName: "kube-api-access-wpwlq") pod "2e504470-5890-484a-b9cb-16ea04cb63b7" (UID: "2e504470-5890-484a-b9cb-16ea04cb63b7"). InnerVolumeSpecName "kube-api-access-wpwlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:52:48.583187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.583159    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e504470-5890-484a-b9cb-16ea04cb63b7-tls-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.583187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.583181    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e504470-5890-484a-b9cb-16ea04cb63b7-dshm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.583326 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.583193    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpwlq\" (UniqueName: \"kubernetes.io/projected/2e504470-5890-484a-b9cb-16ea04cb63b7-kube-api-access-wpwlq\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:48.626554 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.626498    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e504470-5890-484a-b9cb-16ea04cb63b7" containerID="f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10" exitCode=0
Jul 23 18:52:48.626554 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.626546    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"
Jul 23 18:52:48.626675 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.626566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" event={"ID":"2e504470-5890-484a-b9cb-16ea04cb63b7","Type":"ContainerDied","Data":"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"}
Jul 23 18:52:48.626675 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.626597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp" event={"ID":"2e504470-5890-484a-b9cb-16ea04cb63b7","Type":"ContainerDied","Data":"7fa457e69547d3c0b7c051e427fc424907a6e18afa82bdd061dcda99ad72128d"}
Jul 23 18:52:48.626675 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.626613    2579 scope.go:117] "RemoveContainer" containerID="f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"
Jul 23 18:52:48.637600 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.637568    2579 scope.go:117] "RemoveContainer" containerID="f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"
Jul 23 18:52:48.637870 ip-10-0-143-244 kubenswrapper[2579]: E0723 18:52:48.637853    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10\": container with ID starting with f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10 not found: ID does not exist" containerID="f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"
Jul 23 18:52:48.637920 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.637878    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10"} err="failed to get container status \"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10\": rpc error: code = NotFound desc = could not find container \"f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10\": container with ID starting with f5ae6f549d12897c6a79ac45a82cbba4a0d4168f868f7dbaf40924cb2507fd10 not found: ID does not exist"
Jul 23 18:52:48.651430 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.651408    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:52:48.655702 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.655680    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2fc9f5/rate-test-model-2fc9f5-kserve-7848d8459-rklgp"]
Jul 23 18:52:48.746998 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.746970    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e504470-5890-484a-b9cb-16ea04cb63b7" path="/var/lib/kubelet/pods/2e504470-5890-484a-b9cb-16ea04cb63b7/volumes"
Jul 23 18:52:48.747360 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:48.747347    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" path="/var/lib/kubelet/pods/cbc1b031-4a11-438e-b387-0d50a4ce42ea/volumes"
Jul 23 18:52:52.422891 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.422813    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"]
Jul 23 18:52:52.423231 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.423197    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerName="main"
Jul 23 18:52:52.423231 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.423207    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerName="main"
Jul 23 18:52:52.423231 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.423223    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e504470-5890-484a-b9cb-16ea04cb63b7" containerName="main"
Jul 23 18:52:52.423231 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.423230    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e504470-5890-484a-b9cb-16ea04cb63b7" containerName="main"
Jul 23 18:52:52.427808 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.427076    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e504470-5890-484a-b9cb-16ea04cb63b7" containerName="main"
Jul 23 18:52:52.427808 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.427114    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc1b031-4a11-438e-b387-0d50a4ce42ea" containerName="main"
Jul 23 18:52:52.432575 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.432545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:52.435637 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.435604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\""
Jul 23 18:52:52.436410 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.436386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:52:52.437939 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.437908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"]
Jul 23 18:52:52.514165 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.514134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h\" (UID: \"85606c0f-2b93-4900-8374-ca8f9b5a66fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:52.615586 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.615559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h\" (UID: \"85606c0f-2b93-4900-8374-ca8f9b5a66fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:52.616109 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.616094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h\" (UID: \"85606c0f-2b93-4900-8374-ca8f9b5a66fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:52.744317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.744263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:52.884441 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:52.884416    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"]
Jul 23 18:52:52.887274 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:52:52.887231    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85606c0f_2b93_4900_8374_ca8f9b5a66fa.slice/crio-f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224 WatchSource:0}: Error finding container f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224: Status 404 returned error can't find the container with id f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224
Jul 23 18:52:53.653913 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:53.653883    2579 generic.go:356] "Generic (PLEG): container finished" podID="85606c0f-2b93-4900-8374-ca8f9b5a66fa" containerID="8dcee11b0b1b646f99699d07718dd5920d7ab0989d788b87c569f388a680e217" exitCode=0
Jul 23 18:52:53.654251 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:53.653960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h" event={"ID":"85606c0f-2b93-4900-8374-ca8f9b5a66fa","Type":"ContainerDied","Data":"8dcee11b0b1b646f99699d07718dd5920d7ab0989d788b87c569f388a680e217"}
Jul 23 18:52:53.654251 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:53.654019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h" event={"ID":"85606c0f-2b93-4900-8374-ca8f9b5a66fa","Type":"ContainerStarted","Data":"f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224"}
Jul 23 18:52:54.792240 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:54.792217    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:54.935678 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:54.935608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca\") pod \"85606c0f-2b93-4900-8374-ca8f9b5a66fa\" (UID: \"85606c0f-2b93-4900-8374-ca8f9b5a66fa\") "
Jul 23 18:52:54.935953 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:54.935933    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85606c0f-2b93-4900-8374-ca8f9b5a66fa" (UID: "85606c0f-2b93-4900-8374-ca8f9b5a66fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:52:55.036836 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:55.036812    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85606c0f-2b93-4900-8374-ca8f9b5a66fa-maas-api-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:52:55.665152 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:55.665114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h" event={"ID":"85606c0f-2b93-4900-8374-ca8f9b5a66fa","Type":"ContainerDied","Data":"f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224"}
Jul 23 18:52:55.665152 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:55.665134    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"
Jul 23 18:52:55.665427 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:52:55.665165    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f12355dc886aef1dd42af468a42c84d3e6dcd9cb445f5146712acf6a70747224"
Jul 23 18:53:05.679102 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:05.679068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:53:07.535379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:07.535346    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"]
Jul 23 18:53:07.538625 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:07.538600    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-718e88-jmj8h"]
Jul 23 18:53:08.746962 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:08.746929    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85606c0f-2b93-4900-8374-ca8f9b5a66fa" path="/var/lib/kubelet/pods/85606c0f-2b93-4900-8374-ca8f9b5a66fa/volumes"
Jul 23 18:53:15.266867 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.266833    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"]
Jul 23 18:53:15.267235 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.267181    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85606c0f-2b93-4900-8374-ca8f9b5a66fa" containerName="revoke-keys"
Jul 23 18:53:15.267235 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.267192    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85606c0f-2b93-4900-8374-ca8f9b5a66fa" containerName="revoke-keys"
Jul 23 18:53:15.267313 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.267262    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85606c0f-2b93-4900-8374-ca8f9b5a66fa" containerName="revoke-keys"
Jul 23 18:53:15.270388 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.270370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:15.273106 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.273086    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:53:15.273440 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.273419    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4sxmg\""
Jul 23 18:53:15.279414 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.279394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"]
Jul 23 18:53:15.308626 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.308603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w\" (UID: \"1f3e448c-2860-45b6-82d8-3c4ae7c34620\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:15.409612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.409581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w\" (UID: \"1f3e448c-2860-45b6-82d8-3c4ae7c34620\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:15.410193 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.410176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w\" (UID: \"1f3e448c-2860-45b6-82d8-3c4ae7c34620\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:15.581615 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.581592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:15.723103 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.723080    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"]
Jul 23 18:53:15.725121 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:53:15.725094    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3e448c_2860_45b6_82d8_3c4ae7c34620.slice/crio-01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d WatchSource:0}: Error finding container 01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d: Status 404 returned error can't find the container with id 01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d
Jul 23 18:53:15.760196 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:15.760168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w" event={"ID":"1f3e448c-2860-45b6-82d8-3c4ae7c34620","Type":"ContainerStarted","Data":"01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d"}
Jul 23 18:53:16.772239 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:16.772151    2579 generic.go:356] "Generic (PLEG): container finished" podID="1f3e448c-2860-45b6-82d8-3c4ae7c34620" containerID="ea488fdf3b15d2b32472fc3219f4dd4a9c42aa7f3bdc978e556d2958455cc941" exitCode=0
Jul 23 18:53:16.772593 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:16.772242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w" event={"ID":"1f3e448c-2860-45b6-82d8-3c4ae7c34620","Type":"ContainerDied","Data":"ea488fdf3b15d2b32472fc3219f4dd4a9c42aa7f3bdc978e556d2958455cc941"}
Jul 23 18:53:17.910340 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:17.910317    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:18.034493 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.034417    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca\") pod \"1f3e448c-2860-45b6-82d8-3c4ae7c34620\" (UID: \"1f3e448c-2860-45b6-82d8-3c4ae7c34620\") "
Jul 23 18:53:18.034764 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.034742    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1f3e448c-2860-45b6-82d8-3c4ae7c34620" (UID: "1f3e448c-2860-45b6-82d8-3c4ae7c34620"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:53:18.135191 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.135154    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3e448c-2860-45b6-82d8-3c4ae7c34620-maas-api-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Jul 23 18:53:18.783876 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.783837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w" event={"ID":"1f3e448c-2860-45b6-82d8-3c4ae7c34620","Type":"ContainerDied","Data":"01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d"}
Jul 23 18:53:18.784012 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.783897    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01b8935111064e32d324ed4d8c7a41067f6a5a5421d11b709dc1b7927b2c8d8d"
Jul 23 18:53:18.784012 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:18.783907    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"
Jul 23 18:53:28.688193 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:28.688155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bfk97"]
Jul 23 18:53:30.374620 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:30.374583    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"]
Jul 23 18:53:30.377064 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:30.377040    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-2fc9f5-db28w"]
Jul 23 18:53:30.747725 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:30.747634    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3e448c-2860-45b6-82d8-3c4ae7c34620" path="/var/lib/kubelet/pods/1f3e448c-2860-45b6-82d8-3c4ae7c34620/volumes"
Jul 23 18:53:46.733404 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:46.733370    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b5877c86-ttcbb_94caa482-3f03-4fe8-aefb-a986a1071550/copy-manifests/0.log"
Jul 23 18:53:46.744013 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:46.743982    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b5877c86-ttcbb_94caa482-3f03-4fe8-aefb-a986a1071550/manager/0.log"
Jul 23 18:53:49.614405 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:49.614376    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8q95k_8f2f4e36-0c31-44ef-8a09-5cad13bc06ad/kuadrant-console-plugin/0.log"
Jul 23 18:53:50.033227 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:50.033149    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bfk97_dfae5232-804f-41dc-9eb7-e3703d850d3f/limitador/0.log"
Jul 23 18:53:50.906860 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:50.906745    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f87ff99bf-cpn79_5ceee695-e727-452a-8b8d-89a0e51d8652/kube-auth-proxy/0.log"
Jul 23 18:53:51.400698 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:51.400649    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5bc49b8-tr9lr_b983cccf-bb1c-431a-ab76-0a89e6ea9367/router/0.log"
Jul 23 18:53:52.123651 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:52.123623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgpfnf_b893b5a1-cb23-4322-b992-13fb02a4aaa4/main/0.log"
Jul 23 18:53:52.250423 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:52.250383    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rdkf9_c227f42a-288a-41b4-88dc-8aab17d0fe76/main/0.log"
Jul 23 18:53:52.369527 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:53:52.369502    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dm674_12df3636-5aa7-4ff1-93d9-df41d5ef54a1/main/0.log"
Jul 23 18:54:01.903578 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:01.903547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qv8nx_3e709b8e-9dbd-4254-bb8d-b31c4e3592a8/global-pull-secret-syncer/0.log"
Jul 23 18:54:02.185645 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:02.185567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bzbhh_1db4f78f-c6e8-48dd-959e-0be812cfdec0/konnectivity-agent/0.log"
Jul 23 18:54:02.289868 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:02.289844    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-244.ec2.internal_86f9821a2022aa66ebb58ac7570e2dc3/haproxy/0.log"
Jul 23 18:54:07.475966 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:07.475933    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8q95k_8f2f4e36-0c31-44ef-8a09-5cad13bc06ad/kuadrant-console-plugin/0.log"
Jul 23 18:54:07.792991 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:07.792967    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bfk97_dfae5232-804f-41dc-9eb7-e3703d850d3f/limitador/0.log"
Jul 23 18:54:09.902111 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:09.902078    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-spqxk_5abd4122-6989-4780-bb88-cc36a881b421/cluster-monitoring-operator/0.log"
Jul 23 18:54:09.942754 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:09.942722    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nx67v_ef316692-872b-491b-87b3-103bdbe1d9a7/kube-state-metrics/0.log"
Jul 23 18:54:09.963317 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:09.963295    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nx67v_ef316692-872b-491b-87b3-103bdbe1d9a7/kube-rbac-proxy-main/0.log"
Jul 23 18:54:09.994379 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:09.994355    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-nx67v_ef316692-872b-491b-87b3-103bdbe1d9a7/kube-rbac-proxy-self/0.log"
Jul 23 18:54:10.284962 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.284879    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2dlk_79420e4f-f2ac-4b2d-a72c-3cccb81b480d/node-exporter/0.log"
Jul 23 18:54:10.310112 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.310082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2dlk_79420e4f-f2ac-4b2d-a72c-3cccb81b480d/kube-rbac-proxy/0.log"
Jul 23 18:54:10.337826 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.337803    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n2dlk_79420e4f-f2ac-4b2d-a72c-3cccb81b480d/init-textfile/0.log"
Jul 23 18:54:10.484045 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.484008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/prometheus/0.log"
Jul 23 18:54:10.515967 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.515943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/config-reloader/0.log"
Jul 23 18:54:10.544148 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.544085    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/thanos-sidecar/0.log"
Jul 23 18:54:10.572498 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.572481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/kube-rbac-proxy-web/0.log"
Jul 23 18:54:10.605200 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.605180    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/kube-rbac-proxy/0.log"
Jul 23 18:54:10.654618 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.654599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/kube-rbac-proxy-thanos/0.log"
Jul 23 18:54:10.679880 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.679860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b452f24-037f-40a3-83b4-a89cd8ca08aa/init-config-reloader/0.log"
Jul 23 18:54:10.724143 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.724122    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-z4srw_7fb140fe-e6f3-4668-8e70-10601dfd2be9/prometheus-operator/0.log"
Jul 23 18:54:10.752502 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.752481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-z4srw_7fb140fe-e6f3-4668-8e70-10601dfd2be9/kube-rbac-proxy/0.log"
Jul 23 18:54:10.781822 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.781800    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-8npfp_bb6538fc-b066-4d9b-84d2-176134f6575b/prometheus-operator-admission-webhook/0.log"
Jul 23 18:54:10.814093 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.814070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8489f4cf46-s8mfp_0448fc5a-7017-4aeb-941f-38b763d3f9c3/telemeter-client/0.log"
Jul 23 18:54:10.839621 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.839598    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8489f4cf46-s8mfp_0448fc5a-7017-4aeb-941f-38b763d3f9c3/reload/0.log"
Jul 23 18:54:10.865511 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:10.865494    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8489f4cf46-s8mfp_0448fc5a-7017-4aeb-941f-38b763d3f9c3/kube-rbac-proxy/0.log"
Jul 23 18:54:11.720542 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.720493    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"]
Jul 23 18:54:11.721023 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.720971    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3e448c-2860-45b6-82d8-3c4ae7c34620" containerName="revoke-keys"
Jul 23 18:54:11.721023 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.720990    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3e448c-2860-45b6-82d8-3c4ae7c34620" containerName="revoke-keys"
Jul 23 18:54:11.721152 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.721103    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3e448c-2860-45b6-82d8-3c4ae7c34620" containerName="revoke-keys"
Jul 23 18:54:11.724319 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.724301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.726361 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.726340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jc7fz\"/\"openshift-service-ca.crt\""
Jul 23 18:54:11.727248 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.727219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jc7fz\"/\"default-dockercfg-zx572\""
Jul 23 18:54:11.727248 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.727221    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jc7fz\"/\"kube-root-ca.crt\""
Jul 23 18:54:11.733760 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.733738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"]
Jul 23 18:54:11.787975 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.787955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-lib-modules\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.788080 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.787984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-sys\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.788080 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.788011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-podres\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.788080 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.788059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5grr\" (UniqueName: \"kubernetes.io/projected/4184567f-1b52-4ecb-9453-14bb1c7e7853-kube-api-access-p5grr\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.788187 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.788100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-proc\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888542 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5grr\" (UniqueName: \"kubernetes.io/projected/4184567f-1b52-4ecb-9453-14bb1c7e7853-kube-api-access-p5grr\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888642 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-proc\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888642 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-lib-modules\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888724 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-sys\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888724 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-podres\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-proc\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-sys\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888835 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-podres\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.888939 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.888834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4184567f-1b52-4ecb-9453-14bb1c7e7853-lib-modules\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:11.898390 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:11.898368    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5grr\" (UniqueName: \"kubernetes.io/projected/4184567f-1b52-4ecb-9453-14bb1c7e7853-kube-api-access-p5grr\") pod \"perf-node-gather-daemonset-4xkjc\" (UID: \"4184567f-1b52-4ecb-9453-14bb1c7e7853\") " pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:12.036021 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:12.035954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:12.187609 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:12.187569    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"]
Jul 23 18:54:12.190431 ip-10-0-143-244 kubenswrapper[2579]: W0723 18:54:12.190396    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4184567f_1b52_4ecb_9453_14bb1c7e7853.slice/crio-fc55ba047d24eb2bc7347b7c69cbfeb4838ac986aabd3834a1d6641b34029ef4 WatchSource:0}: Error finding container fc55ba047d24eb2bc7347b7c69cbfeb4838ac986aabd3834a1d6641b34029ef4: Status 404 returned error can't find the container with id fc55ba047d24eb2bc7347b7c69cbfeb4838ac986aabd3834a1d6641b34029ef4
Jul 23 18:54:12.308922 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:12.308897    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-k6g2k_3e77422b-8dbe-4341-b061-b0bd8c933c2a/networking-console-plugin/0.log"
Jul 23 18:54:12.936794 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:12.936758    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/1.log"
Jul 23 18:54:12.943612 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:12.943586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-54cdl_21c2b6a0-7479-4aa8-b71c-b9afb187d6d3/console-operator/2.log"
Jul 23 18:54:13.034314 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:13.034282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc" event={"ID":"4184567f-1b52-4ecb-9453-14bb1c7e7853","Type":"ContainerStarted","Data":"d7c72026bc899ff89595b588795c08377541e054de78f8c3e8b5527b067ce8c6"}
Jul 23 18:54:13.034478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:13.034340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc" event={"ID":"4184567f-1b52-4ecb-9453-14bb1c7e7853","Type":"ContainerStarted","Data":"fc55ba047d24eb2bc7347b7c69cbfeb4838ac986aabd3834a1d6641b34029ef4"}
Jul 23 18:54:13.034478 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:13.034368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:13.053981 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:13.053938    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc" podStartSLOduration=2.053922914 podStartE2EDuration="2.053922914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:54:13.051663915 +0000 UTC m=+2862.781096433" watchObservedRunningTime="2026-07-23 18:54:13.053922914 +0000 UTC m=+2862.783355465"
Jul 23 18:54:14.193871 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:14.193842    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-k9ct9_295d0dbb-aaf0-4180-b016-3c969365f556/volume-data-source-validator/0.log"
Jul 23 18:54:15.366928 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:15.366898    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tg5l_4a7e4e8b-5e68-4b25-9211-c7948d9d7e18/dns/0.log"
Jul 23 18:54:15.396809 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:15.396771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6tg5l_4a7e4e8b-5e68-4b25-9211-c7948d9d7e18/kube-rbac-proxy/0.log"
Jul 23 18:54:15.616124 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:15.616096    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvcxt_f44b0cd6-0e92-4aa2-b099-17084090001a/dns-node-resolver/0.log"
Jul 23 18:54:16.262276 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:16.262244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c8js9_a4bb8a44-9c96-4570-bb4d-8824ef5607c9/node-ca/0.log"
Jul 23 18:54:17.828006 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:17.827972    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f87ff99bf-cpn79_5ceee695-e727-452a-8b8d-89a0e51d8652/kube-auth-proxy/0.log"
Jul 23 18:54:18.045950 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:18.045919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5bc49b8-tr9lr_b983cccf-bb1c-431a-ab76-0a89e6ea9367/router/0.log"
Jul 23 18:54:18.810591 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:18.810560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-999l7_0f5e0924-1df0-421b-99ee-e1c23b8eacd2/serve-healthcheck-canary/0.log"
Jul 23 18:54:19.048592 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.048567    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jc7fz/perf-node-gather-daemonset-4xkjc"
Jul 23 18:54:19.380100 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.380058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tgspg_977625e7-860e-4c7c-983e-c363dec5329a/insights-operator/0.log"
Jul 23 18:54:19.381688 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.381661    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tgspg_977625e7-860e-4c7c-983e-c363dec5329a/insights-operator/1.log"
Jul 23 18:54:19.493931 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.493904    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd29m_47869ec2-cde4-4899-ae3c-4c459f0f966e/kube-rbac-proxy/0.log"
Jul 23 18:54:19.521658 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.521641    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd29m_47869ec2-cde4-4899-ae3c-4c459f0f966e/exporter/0.log"
Jul 23 18:54:19.550876 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:19.550858    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dd29m_47869ec2-cde4-4899-ae3c-4c459f0f966e/extractor/0.log"
Jul 23 18:54:22.893341 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:22.893315    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b5877c86-ttcbb_94caa482-3f03-4fe8-aefb-a986a1071550/manager/0.log"
Jul 23 18:54:22.929039 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:22.929013    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b5877c86-ttcbb_94caa482-3f03-4fe8-aefb-a986a1071550/copy-manifests/0.log"
Jul 23 18:54:23.106238 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:23.106212    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f87ff99bf-cpn79_5ceee695-e727-452a-8b8d-89a0e51d8652/kube-auth-proxy/0.log"
Jul 23 18:54:23.270853 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:23.270822    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5bc49b8-tr9lr_b983cccf-bb1c-431a-ab76-0a89e6ea9367/router/0.log"
Jul 23 18:54:24.455901 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:24.455872    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7676b4f7b4-ck76h_cb3f940e-b167-458d-a5e8-6236a41e7ecf/manager/0.log"
Jul 23 18:54:24.858256 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:24.858208    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f87ff99bf-cpn79_5ceee695-e727-452a-8b8d-89a0e51d8652/kube-auth-proxy/0.log"
Jul 23 18:54:25.013695 ip-10-0-143-244 kubenswrapper[2579]: I0723 18:54:25.013658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78f5bc49b8-tr9lr_b983cccf-bb1c-431a-ab76-0a89e6ea9367/router/0.log"