Jul 14 00:57:55.970180 ip-10-0-137-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 00:57:55.970199 ip-10-0-137-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 00:57:55.970208 ip-10-0-137-153 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 00:57:55.970552 ip-10-0-137-153 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 00:58:06.003677 ip-10-0-137-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 00:58:06.003700 ip-10-0-137-153 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dff986b6815042d6b7537de7e7b405ca --
Jul 14 01:00:04.705800 ip-10-0-137-153 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 01:00:05.136757 ip-10-0-137-153 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 01:00:05.136757 ip-10-0-137-153 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 01:00:05.136757 ip-10-0-137-153 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 01:00:05.136757 ip-10-0-137-153 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 01:00:05.136757 ip-10-0-137-153 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 01:00:05.137462 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.136818    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 01:00:05.143233 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143214    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.143233 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143230    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.143233 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143235    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143239    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143242    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143245    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143248    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143250    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143253    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143256    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143259    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143261    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143264    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143266    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143269    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143271    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143274    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143276    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143279    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143282    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143284    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143286    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.143323 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143289    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143291    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143294    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143298    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143302    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143305    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143308    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143312    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143315    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143318    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143321    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143323    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143326    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143329    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143332    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143335    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143337    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143341    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143344    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143346    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.143810 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143348    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143351    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143353    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143356    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143359    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143361    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143364    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143366    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143369    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143371    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143373    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143376    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143378    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143382    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143385    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143387    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143390    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143393    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143396    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143399    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.144290 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143401    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143404    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143406    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143408    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143411    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143413    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143416    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143418    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143421    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143423    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143426    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143428    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143430    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143433    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143435    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143438    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143440    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143444    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143446    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143448    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.144788 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143451    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143453    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143456    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143459    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143461    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143464    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143469    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143471    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143474    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143476    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143479    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143484    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143500    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143504    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143507    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143510    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.143514    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145027    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.145256 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145034    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145040    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145044    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145047    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145049    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145052    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145055    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145058    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145061    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145064    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145067    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145069    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145072    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145075    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145077    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145080    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145083    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145085    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145087    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.145700 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145090    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145093    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145096    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145098    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145101    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145103    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145106    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145109    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145112    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145115    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145117    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145119    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145122    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145124    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145127    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145131    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145133    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145136    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145139    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145141    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.146162 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145144    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145146    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145148    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145151    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145153    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145156    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145158    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145160    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145163    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145165    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145167    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145170    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145173    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145176    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145179    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145181    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145184    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145186    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145190    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145194    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.146674 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145197    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145200    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145202    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145205    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145207    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145209    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145212    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145214    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145217    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145219    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145222    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145224    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145226    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145229    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145231    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145234    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145236    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145239    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145241    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.147250 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145245    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145249    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145253    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145256    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145259    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145261    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145264    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145267    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145270    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145273    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145275    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145278    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145280    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145283    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145285    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145288    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145290    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145293    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145295    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145298    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.147726 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145685    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145691    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145694    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145697    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145700    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145703    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145705    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145708    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145711    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145715    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145719    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145722    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145724    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145727    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145730    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145732    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145734    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145737    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145741    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145744    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.148203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145747    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145750    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145752    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145754    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145757    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145759    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145762    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145765    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145767    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145770    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145772    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145775    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145777    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145779    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145782    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145784    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145787    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145789    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145792    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145794    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.148734 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145797    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145799    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145802    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145804    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145807    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145810    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145812    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145815    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145817    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145819    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145822    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145824    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145826    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145829    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145831    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145833    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145837    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145841    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145844    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145847    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.149220 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145849    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145852    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145854    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145856    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145859    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145861    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145863    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145866    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145868    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145870    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145872    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145875    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145878    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145880    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145883    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145886    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145889    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145892    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145895    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.149710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145897    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145900    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145903    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145905    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145908    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145910    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145912    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145915    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145917    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145919    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145922    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145924    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145926    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145929    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145932    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145934    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145936    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145938    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145941    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.145943    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.150195 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146021    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146031    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146039    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146046    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146052    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146055    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146059    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146063    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146066    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146070    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146073    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146076    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146080    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146083    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146085    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146088    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146091    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146094    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146099    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146102    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146106    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146109    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146112    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146116    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 01:00:05.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146119    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146122    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146125    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146128    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146131    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146134    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146137    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146139    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146143    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146147    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146150    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146152    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146155    2565 flags.go:64] FLAG: --enable-server="true"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146158    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146163    2565 flags.go:64] FLAG: --event-burst="100"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146166    2565 flags.go:64] FLAG: --event-qps="50"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146169    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146172    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146175    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146179    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146182    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146185    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146188    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146191    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146194    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 01:00:05.151260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146196    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146199    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146202    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146205    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146207    2565 flags.go:64] FLAG: --feature-gates=""
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146211    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146214    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146217    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146219    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146222    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146226    2565 flags.go:64] FLAG: --help="false"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146229    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146232    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146235    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146238    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146241    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146247    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146250    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146253    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146256    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146259    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146263    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146266    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146269    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 14 01:00:05.151919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146272    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146275    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146278    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146281    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146284    2565 flags.go:64] FLAG: --lock-file=""
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146287    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146289    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146292    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146297    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146300    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146303    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146306    2565 flags.go:64] FLAG: --logging-format="text"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146309    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146312    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146314    2565 flags.go:64] FLAG: --manifest-url=""
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146317    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146322    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146324    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146328    2565 flags.go:64] FLAG: --max-pods="110"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146332    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146335    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146337    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146340    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146343    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146347    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 01:00:05.152552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146350    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146357    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146360    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146363    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146367    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146370    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146375    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146377    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146380    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146384    2565 flags.go:64] FLAG: --port="10250"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146387    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146389    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07df0a64226d9ba5f"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146392    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146395    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146406    2565 flags.go:64] FLAG: --register-node="true"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146410    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146413    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146416    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146419    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146422    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146426    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146429    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146432    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146434    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146437    2565 flags.go:64] FLAG: --runonce="false"
Jul 14 01:00:05.153199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146440    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146443    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146446    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146449    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146452    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146455    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146458    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146462    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146465    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146468    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146471    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146475    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146478    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146480    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146483    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146501    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146504    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146507    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146512    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146515    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146518    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146520    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146523    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146526    2565 flags.go:64] FLAG: --v="2"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146530    2565 flags.go:64] FLAG: --version="false"
Jul 14 01:00:05.154194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146537    2565 flags.go:64] FLAG: --vmodule=""
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146541    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.146544    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146666    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146670    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146673    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146677    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146680    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146682    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146685    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146688    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146691    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146693    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146696    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146699    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146702    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146704    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146707    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146711    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146714    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146716    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.154998 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146718    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146722    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146724    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146726    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146729    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146732    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146734    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146737    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146740    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146742    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146744    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146747    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146749    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146752    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146754    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146757    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146759    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146762    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146764    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146766    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.155571 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146769    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146771    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146774    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146777    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146779    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146782    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146785    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146787    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146790    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146793    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146796    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146798    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146800    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146803    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146805    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146808    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146810    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146813    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146815    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.156053 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146820    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146823    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146825    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146828    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146831    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146833    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146836    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146838    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146841    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146844    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146846    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146849    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146851    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146854    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146856    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146859    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146861    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146864    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146867    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.156533 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146871    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146875    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146878    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146883    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146886    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146889    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146892    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146894    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146896    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146899    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146902    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146904    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146907    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146909    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146911    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146914    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146916    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146919    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146922    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.157001 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146926    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146928    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146931    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.146933    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.147663    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.155618    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.155634    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.156444    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.156456    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156533    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156540    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156545    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156549    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156551    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156554    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.157459 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156557    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156560    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156564    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156569    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156572    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156575    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156577    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156580    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156582    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156585    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156588    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156591    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156594    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156596    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156598    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156601    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156604    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156607    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156610    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.157912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156612    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156614    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156617    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156621    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156625    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156628    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156631    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156634    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156636    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156639    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156642    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156644    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156647    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156649    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156652    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156654    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156656    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156659    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156661    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156664    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.158365 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156666    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156669    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156672    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156674    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156677    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156679    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156682    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156684    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156687    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156690    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156692    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156695    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156698    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156700    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156703    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156705    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156709    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156711    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156714    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156717    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.158868 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156719    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156722    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156724    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156727    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156729    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156731    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156734    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156736    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156739    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156741    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156744    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156746    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156748    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156750    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156753    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156756    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156759    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156761    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156763    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.159369 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156766    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156769    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156773    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156776    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156779    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156781    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156784    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156787    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156789    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156792    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156795    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156797    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156800    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156802    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.159878 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156805    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.156809    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156923    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156928    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156932    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156935    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156937    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156940    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156944    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156946    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156949    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156953    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156956    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156959    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156963    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 01:00:05.160219 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156966    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156968    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156972    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156975    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156977    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156980    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156983    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156985    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156987    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156990    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156992    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156994    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156997    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.156999    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157002    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157005    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157008    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157010    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157013    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157016    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 01:00:05.160604 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157018    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157022    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157024    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157027    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157029    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157032    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157034    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157037    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157039    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157042    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157044    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157046    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157049    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157052    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157054    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157056    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157059    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157061    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157064    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 01:00:05.161101 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157066    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157069    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157072    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157074    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157076    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157078    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157081    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157083    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157086    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157089    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157091    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157093    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157096    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157098    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157101    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157103    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157105    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157108    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157110    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157112    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 01:00:05.161580 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157115    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157117    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157120    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157122    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157124    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157127    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157130    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157132    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157135    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157137    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157140    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157142    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157145    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157147    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157149    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157152    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157154    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157157    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157159    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157162    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 01:00:05.162060 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157164    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157167    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157169    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157172    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157174    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157178    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:05.157181    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.157186    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.157310    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.159210    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.160627    2565 server.go:1019] "Starting client certificate rotation"
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.160728    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 01:00:05.162676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.160768    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 01:00:05.163117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.163104    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 01:00:05.164378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.164342    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 01:00:05.176099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.176081    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 14 01:00:05.180064 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.180050    2565 log.go:25] "Validated CRI v1 image API"
Jul 14 01:00:05.180981 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.180967    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 01:00:05.184817 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.184798    2565 fs.go:135] Filesystem UUIDs: map[1477e12b-b95f-467c-a8d6-ed8ced83e24a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87abe277-652b-49ae-9c40-9916abc7bfb0:/dev/nvme0n1p3]
Jul 14 01:00:05.184867 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.184817    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 01:00:05.191085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.191062    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 01:00:05.193709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.193596    2565 manager.go:216] Machine: {Timestamp:2026-07-14 01:00:05.192209483 +0000 UTC m=+0.366151071 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080212 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2464b7d74fc3fbf751abd14d6c6a00 SystemUUID:ec2464b7-d74f-c3fb-f751-abd14d6c6a00 BootID:dff986b6-8150-42d6-b753-7de7e7b405ca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bd:8f:e0:c0:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bd:8f:e0:c0:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:3a:25:1d:ec:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 01:00:05.193709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.193705    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 01:00:05.193844 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.193798    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 01:00:05.197091 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.197066    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 01:00:05.197227 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.197095    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 01:00:05.197889 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.197879    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 01:00:05.197926 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.197892    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 01:00:05.197926 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.197900    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 01:00:05.198761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.198750    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 01:00:05.199954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.199944    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 01:00:05.203531 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203519    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 01:00:05.203666 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203656    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 01:00:05.203708 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203687    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 01:00:05.203708 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203696    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 01:00:05.203777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203711    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 01:00:05.203777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203720    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 14 01:00:05.203777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.203730    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 01:00:05.204180 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.204146    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 01:00:05.204180 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.204168    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 01:00:05.207384 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.207364    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 01:00:05.207737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.207722    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p7jhw"
Jul 14 01:00:05.209329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.209315    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 01:00:05.209368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.209345    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 01:00:05.210062 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210044    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 01:00:05.210099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210072    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 01:00:05.210099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210080    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 01:00:05.210099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210085    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 01:00:05.210099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210094    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 01:00:05.210099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210099    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210218    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210224    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210232    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210244    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210257    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 01:00:05.210305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.210265    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 01:00:05.211238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.211225    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 01:00:05.211238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.211238    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 01:00:05.212241 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.212220    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 01:00:05.212241 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.212219    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 01:00:05.214829 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.214816    2565 server.go:1268] "Started kubelet"
Jul 14 01:00:05.214977 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.214949    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 01:00:05.215142 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.215093    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 01:00:05.215190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.215173    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 01:00:05.215452 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.215420    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p7jhw"
Jul 14 01:00:05.216003 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.215981    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 01:00:05.216080 ip-10-0-137-153 systemd[1]: Started Kubernetes Kubelet.
Jul 14 01:00:05.216395 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.216350    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 01:00:05.217843 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.217824    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 01:00:05.222881 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.222861    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 01:00:05.223615 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.222588    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-153.ec2.internal.18c2022f7363eec7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-153.ec2.internal,UID:ip-10-0-137-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-153.ec2.internal,},FirstTimestamp:2026-07-14 01:00:05.214785223 +0000 UTC m=+0.388726811,LastTimestamp:2026-07-14 01:00:05.214785223 +0000 UTC m=+0.388726811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-153.ec2.internal,}"
Jul 14 01:00:05.224455 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.224439    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 01:00:05.224455 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.224450    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 01:00:05.224596 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.224554    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.225132 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225115    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 01:00:05.225229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225135    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 01:00:05.225229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225225    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 01:00:05.225343 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225299    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 01:00:05.225343 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225307    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 01:00:05.225766 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225749    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 01:00:05.225822 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225769    2565 factory.go:55] Registering systemd factory
Jul 14 01:00:05.225822 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.225779    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 14 01:00:05.226036 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.226023    2565 factory.go:153] Registering CRI-O factory
Jul 14 01:00:05.226036 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.226036    2565 factory.go:223] Registration of the crio container factory successfully
Jul 14 01:00:05.226132 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.226053    2565 factory.go:103] Registering Raw factory
Jul 14 01:00:05.226132 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.226062    2565 manager.go:1196] Started watching for new ooms in manager
Jul 14 01:00:05.226585 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.226571    2565 manager.go:349] Starting recovery of all containers
Jul 14 01:00:05.228634 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.228616    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:05.230626 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.230604    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-153.ec2.internal\" not found" node="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.234131 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.233964    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 01:00:05.236439 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.236422    2565 manager.go:354] Recovery completed
Jul 14 01:00:05.242136 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.242120    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.244121 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244105    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.244183 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244134    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.244183 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244145    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.244710 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244696    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 01:00:05.244710 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244707    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 01:00:05.244804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244724    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 01:00:05.244804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.244726    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.245436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.245421    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.245554 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.245446    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.245554 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.245456    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.246697 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.246686    2565 policy_none.go:49] "None policy: Start"
Jul 14 01:00:05.246746 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.246701    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 01:00:05.246746 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.246712    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 01:00:05.248567 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.248555    2565 policy_none.go:47] "Start"
Jul 14 01:00:05.288102 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288085    2565 manager.go:337] "Starting Device Plugin manager"
Jul 14 01:00:05.288216 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.288125    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 01:00:05.288216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288138    2565 server.go:87] "Starting device plugin registration server"
Jul 14 01:00:05.288428 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288414    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 01:00:05.288485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288431    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 01:00:05.288575 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288553    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 01:00:05.288683 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288664    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 01:00:05.288683 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.288680    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 01:00:05.289521 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.289478    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 01:00:05.289594 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.289549    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.389029 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.388953    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.391106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.389968    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.391106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.390007    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.391106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.390033    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.391106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.390065    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.391469 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.391452    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 01:00:05.391515 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.391511    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 01:00:05.391550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.391536    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 01:00:05.391629 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.391569    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 01:00:05.393203 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.393157    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:05.399154 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.399139    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.399235 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.399161    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-153.ec2.internal\": node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.479851 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.479812    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.491860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.491828    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"]
Jul 14 01:00:05.491965 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.491939    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.493530 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.493515    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.493618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.493543    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.493618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.493553    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.495827 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.495814    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.495960 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.495944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.496019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.495981    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.496588 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496571    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.496675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496603    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.496675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496617    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.496675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496619    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.496675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496637    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.496675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.496645    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.500886 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.500865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.500978 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.500897    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 01:00:05.501676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.501649    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 01:00:05.501760 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.501680    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 01:00:05.501760 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.501696    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeHasSufficientPID"
Jul 14 01:00:05.523331 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.523307    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-153.ec2.internal\" not found" node="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.527086 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.526877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.527086 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.526905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.527086 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.526922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce38b53631ed0051e61ec9c603fcaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-153.ec2.internal\" (UID: \"4ce38b53631ed0051e61ec9c603fcaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.528397 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.528382    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-153.ec2.internal\" not found" node="ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.580891 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.580860    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.627240 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.627339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce38b53631ed0051e61ec9c603fcaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-153.ec2.internal\" (UID: \"4ce38b53631ed0051e61ec9c603fcaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.627339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.627339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.627339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54a8bec228f3c6b405de9447a5cd0448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal\" (UID: \"54a8bec228f3c6b405de9447a5cd0448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.627512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.627340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4ce38b53631ed0051e61ec9c603fcaa4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-153.ec2.internal\" (UID: \"4ce38b53631ed0051e61ec9c603fcaa4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.681614 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.681542    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.782288 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:05.782248    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:05.825460 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.825431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:05.831982 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:05.831968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:07.655296 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:07.655253    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:07.755880 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:07.755795    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:07.856314 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:07.856276    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:07.932856 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:07.932822    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 01:00:07.933423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:07.932975    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 01:00:07.933423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:07.933012    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 01:00:07.957167 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:07.957117    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:07.996814 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:07.996778    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 00:55:06 +0000 UTC" deadline="2028-02-25 04:46:24.831422545 +0000 UTC"
Jul 14 01:00:07.996814 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:07.996806    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14187h46m16.834620216s"
Jul 14 01:00:08.058323 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:08.058252    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:08.158936 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:08.158878    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-153.ec2.internal\" not found"
Jul 14 01:00:08.208717 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:08.208688    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce38b53631ed0051e61ec9c603fcaa4.slice/crio-b31d5b8b0ebf5801a0a2079f81c35cabe927003fc090da5ac548088285fb8d55 WatchSource:0}: Error finding container b31d5b8b0ebf5801a0a2079f81c35cabe927003fc090da5ac548088285fb8d55: Status 404 returned error can't find the container with id b31d5b8b0ebf5801a0a2079f81c35cabe927003fc090da5ac548088285fb8d55
Jul 14 01:00:08.212739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.212725    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 01:00:08.221387 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.221368    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:08.297255 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.297206    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:08.306550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.306529    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 01:00:08.308666 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.308627    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal"
Jul 14 01:00:08.319490 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.319471    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 01:00:08.554047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.553813    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:08.859367 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:08.859334    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a8bec228f3c6b405de9447a5cd0448.slice/crio-0b507c806367a17f5eecbb17a144df1c5116bf27be5762cee5c2367b81d76be1 WatchSource:0}: Error finding container 0b507c806367a17f5eecbb17a144df1c5116bf27be5762cee5c2367b81d76be1: Status 404 returned error can't find the container with id 0b507c806367a17f5eecbb17a144df1c5116bf27be5762cee5c2367b81d76be1
Jul 14 01:00:08.886427 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.886397    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:08.977920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.977885    2565 apiserver.go:52] "Watching apiserver"
Jul 14 01:00:08.984735 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.984713    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 01:00:08.985138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.985092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5g7tv","openshift-multus/network-metrics-daemon-2f7j6","openshift-network-diagnostics/network-check-target-9mpz2","openshift-network-operator/iptables-alerter-mw7kw","openshift-ovn-kubernetes/ovnkube-node-hmcbl","kube-system/konnectivity-agent-8ttzd","kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg","openshift-cluster-node-tuning-operator/tuned-r8mzr","openshift-dns/node-resolver-kxkrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal","openshift-multus/multus-additional-cni-plugins-fcklr","openshift-multus/multus-qsk57","kube-system/global-pull-secret-syncer-htw8v"]
Jul 14 01:00:08.987575 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.987551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:08.989711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.989691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsk57"
Jul 14 01:00:08.990485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.990465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 01:00:08.990485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.990477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mv7w7\""
Jul 14 01:00:08.990671 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.990522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 01:00:08.991824 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.991795    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 01:00:08.991924 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.991875    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9z4w8\""
Jul 14 01:00:08.992164 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.992146    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 01:00:08.992357 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.992335    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:08.992432 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.992392    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 01:00:08.992488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.992429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 01:00:08.992488 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:08.992433    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:08.994323 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.994307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:08.996297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.996281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 01:00:08.996590 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.996569    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 01:00:08.996840 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.996804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dzfzm\""
Jul 14 01:00:08.996913 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.996899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:08.997061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.997041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 01:00:08.998912 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.998000    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 01:00:08.999193 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.999157    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 01:00:08.999921 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.999637    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 01:00:08.999921 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:08.999662    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 01:00:09.000515 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.000497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tr6kk\""
Jul 14 01:00:09.000598 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.000589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 01:00:09.000798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.000778    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 01:00:09.000864 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.000809    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 01:00:09.001373 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.001354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.003886 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.003871    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 01:00:09.003968 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.003954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7gdfp\""
Jul 14 01:00:09.004138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.004107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 01:00:09.004406 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.004390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.006751 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.006709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.006848 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.006773    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:09.007791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007373    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 01:00:09.007791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.007791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.007791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-config\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-cni-binary-copy\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-bin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-multus\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-conf-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.007972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-etc-kubernetes\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008047 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-script-lib\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8164c2-4186-44a6-8c82-e9918e0b1408-tmp-dir\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-multus-certs\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-iptables-alerter-script\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-var-lib-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3dafbaf1-9368-458e-96ce-a7a1793b2a97-agent-certs\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.008331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b8164c2-4186-44a6-8c82-e9918e0b1408-hosts-file\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-systemd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-log-socket\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-env-overrides\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55babe6b-803b-4816-9d0c-51071969dd69-ovn-node-metrics-cert\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-os-release\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-socket-dir-parent\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-k8s-cni-cncf-io\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-kubelet\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-etc-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-bin\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-netd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pz5r\" (UniqueName: \"kubernetes.io/projected/2b8164c2-4186-44a6-8c82-e9918e0b1408-kube-api-access-6pz5r\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjhw\" (UniqueName: \"kubernetes.io/projected/0c96a14e-94d4-4016-882f-a62c7eeee44a-kube-api-access-kcjhw\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-ovn\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3dafbaf1-9368-458e-96ce-a7a1793b2a97-konnectivity-ca\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-netns\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-hostroot\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-node-log\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4nkw\" (UniqueName: \"kubernetes.io/projected/55babe6b-803b-4816-9d0c-51071969dd69-kube-api-access-s4nkw\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-kubelet\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-daemon-config\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.008969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8g7\" (UniqueName: \"kubernetes.io/projected/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-kube-api-access-fl8g7\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-slash\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-system-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-cnibin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.009161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-host-slash\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.009726 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-systemd-units\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.009726 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.009726 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.009221    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:09.009726 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.009156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-netns\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.010876 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.010665    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 01:00:09.011083 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.011066    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6gcnj\""
Jul 14 01:00:09.011434 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.011416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.014985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.012863    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 01:00:09.014985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.013821    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 01:00:09.014985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.013926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-stz8p\""
Jul 14 01:00:09.014985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.014202    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 01:00:09.014985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.014487    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 01:00:09.016601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.015706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.017994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.017971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 01:00:09.018278 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.018253    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8nbln\""
Jul 14 01:00:09.018805 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.018472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 01:00:09.018805 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.018623    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 01:00:09.019209 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.019190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.021264 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.021248    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 01:00:09.021539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.021449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f27tz\""
Jul 14 01:00:09.021661 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.021647    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 01:00:09.031976 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.031957    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqcrm"
Jul 14 01:00:09.039351 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.039331    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqcrm"
Jul 14 01:00:09.099080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.099049    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 01:00:09.109624 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-sys\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.109624 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-run\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-bin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-etc-kubernetes\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8164c2-4186-44a6-8c82-e9918e0b1408-tmp-dir\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.109787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-multus-certs\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-bin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-iptables-alerter-script\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-var-lib-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-host\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6ms\" (UniqueName: \"kubernetes.io/projected/e8483c11-b065-4cdc-87c7-1baf93340cb7-kube-api-access-2f6ms\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-multus-certs\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-var-lib-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.109929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dt2z\" (UniqueName: \"kubernetes.io/projected/d324260d-db38-4bfb-8e21-bf894cd91a92-kube-api-access-5dt2z\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-etc-kubernetes\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-os-release\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3dafbaf1-9368-458e-96ce-a7a1793b2a97-agent-certs\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-os-release\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b8164c2-4186-44a6-8c82-e9918e0b1408-tmp-dir\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-socket-dir-parent\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-bin\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-netd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-os-release\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-socket-dir-parent\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-registration-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-bin\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-cni-netd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxv4z\" (UniqueName: \"kubernetes.io/projected/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kube-api-access-bxv4z\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.110446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz5r\" (UniqueName: \"kubernetes.io/projected/2b8164c2-4186-44a6-8c82-e9918e0b1408-kube-api-access-6pz5r\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjhw\" (UniqueName: \"kubernetes.io/projected/0c96a14e-94d4-4016-882f-a62c7eeee44a-kube-api-access-kcjhw\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3dafbaf1-9368-458e-96ce-a7a1793b2a97-konnectivity-ca\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-iptables-alerter-script\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110515    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-netns\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-netns\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-hostroot\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-host\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-kube-api-access-vj8ct\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-hostroot\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-socket-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-conf\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-kubelet\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111019 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-daemon-config\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8g7\" (UniqueName: \"kubernetes.io/projected/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-kube-api-access-fl8g7\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-kubelet\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-slash\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.110980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-modprobe-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysconfig\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3dafbaf1-9368-458e-96ce-a7a1793b2a97-konnectivity-ca\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cnibin\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-system-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-slash\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-host-slash\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-systemd-units\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-config\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-host-slash\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-systemd-units\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-system-cni-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.111875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-cni-binary-copy\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-multus\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-conf-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-script-lib\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-var-lib-cni-multus\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-var-lib-kubelet\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-daemon-config\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-device-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-sys-fs\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-multus-conf-dir\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-system-cni-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b8164c2-4186-44a6-8c82-e9918e0b1408-hosts-file\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-systemd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-log-socket\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-env-overrides\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55babe6b-803b-4816-9d0c-51071969dd69-ovn-node-metrics-cert\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4nkw\" (UniqueName: \"kubernetes.io/projected/55babe6b-803b-4816-9d0c-51071969dd69-kube-api-access-s4nkw\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.112564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-k8s-cni-cncf-io\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-kubelet\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c96a14e-94d4-4016-882f-a62c7eeee44a-cni-binary-copy\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-etc-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-etc-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-tuned\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-config\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-ovn\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-kubelet\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-host-run-k8s-cni-cncf-io\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-log-socket\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2b8164c2-4186-44a6-8c82-e9918e0b1408-hosts-file\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.111908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-systemd\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-kubernetes\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-lib-modules\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-node-log\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-serviceca\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.113138 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-ovnkube-script-lib\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55babe6b-803b-4816-9d0c-51071969dd69-env-overrides\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-ovn\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-node-log\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-tmp\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-kubelet-config\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-dbus\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72wv\" (UniqueName: \"kubernetes.io/projected/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-kube-api-access-b72wv\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-cnibin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-netns\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c96a14e-94d4-4016-882f-a62c7eeee44a-cnibin\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.113630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-systemd\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.114187 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-run-openvswitch\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.114187 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.114187 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.112742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55babe6b-803b-4816-9d0c-51071969dd69-host-run-netns\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.114274 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.114194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3dafbaf1-9368-458e-96ce-a7a1793b2a97-agent-certs\") pod \"konnectivity-agent-8ttzd\" (UID: \"3dafbaf1-9368-458e-96ce-a7a1793b2a97\") " pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.114647 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.114631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55babe6b-803b-4816-9d0c-51071969dd69-ovn-node-metrics-cert\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.120654 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.120636    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:09.120654 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.120657    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:09.120819 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.120667    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:09.120819 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.120740    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:09.620719872 +0000 UTC m=+3.022031358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:09.121643 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.121623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8g7\" (UniqueName: \"kubernetes.io/projected/45509e2a-8d8a-41ef-8ecf-a97334ac88c2-kube-api-access-fl8g7\") pod \"iptables-alerter-mw7kw\" (UID: \"45509e2a-8d8a-41ef-8ecf-a97334ac88c2\") " pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.122083 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.122068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjhw\" (UniqueName: \"kubernetes.io/projected/0c96a14e-94d4-4016-882f-a62c7eeee44a-kube-api-access-kcjhw\") pod \"multus-qsk57\" (UID: \"0c96a14e-94d4-4016-882f-a62c7eeee44a\") " pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.122407 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.122388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4nkw\" (UniqueName: \"kubernetes.io/projected/55babe6b-803b-4816-9d0c-51071969dd69-kube-api-access-s4nkw\") pod \"ovnkube-node-hmcbl\" (UID: \"55babe6b-803b-4816-9d0c-51071969dd69\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.122836 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.122812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pz5r\" (UniqueName: \"kubernetes.io/projected/2b8164c2-4186-44a6-8c82-e9918e0b1408-kube-api-access-6pz5r\") pod \"node-resolver-kxkrj\" (UID: \"2b8164c2-4186-44a6-8c82-e9918e0b1408\") " pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.174079 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.174015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal" event={"ID":"4ce38b53631ed0051e61ec9c603fcaa4","Type":"ContainerStarted","Data":"b31d5b8b0ebf5801a0a2079f81c35cabe927003fc090da5ac548088285fb8d55"}
Jul 14 01:00:09.175261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.175233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal" event={"ID":"54a8bec228f3c6b405de9447a5cd0448","Type":"ContainerStarted","Data":"0b507c806367a17f5eecbb17a144df1c5116bf27be5762cee5c2367b81d76be1"}
Jul 14 01:00:09.213685 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213650    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 01:00:09.213861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-tmp\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.213861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-kubelet-config\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.213861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-dbus\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.213861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.213861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.214107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72wv\" (UniqueName: \"kubernetes.io/projected/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-kube-api-access-b72wv\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.214107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-kubelet-config\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.214107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-systemd\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-dbus\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.214324 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.214158    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:09.214324 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.214220    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:09.7142011 +0000 UTC m=+3.115512585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:09.214512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.213902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-systemd\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214590 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-sys\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214590 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.214738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-run\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-host\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6ms\" (UniqueName: \"kubernetes.io/projected/e8483c11-b065-4cdc-87c7-1baf93340cb7-kube-api-access-2f6ms\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.214915 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dt2z\" (UniqueName: \"kubernetes.io/projected/d324260d-db38-4bfb-8e21-bf894cd91a92-kube-api-access-5dt2z\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.214915 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-os-release\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.214915 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.214915 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-registration-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.214915 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxv4z\" (UniqueName: \"kubernetes.io/projected/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kube-api-access-bxv4z\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-host\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-registration-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.214964    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-sys\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-host\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-os-release\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.215068    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:09.715050959 +0000 UTC m=+3.116362430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-run\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.214971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-host\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-kube-api-access-vj8ct\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-socket-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-conf\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-modprobe-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysconfig\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cnibin\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-var-lib-kubelet\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysconfig\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-socket-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-device-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-modprobe-d\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-sys-fs\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-system-cni-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-sys-fs\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.215768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215369    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-sysctl-conf\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cnibin\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-tuned\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-var-lib-kubelet\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-kubernetes\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-lib-modules\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-device-dir\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-system-cni-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-kubernetes\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-serviceca\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8483c11-b065-4cdc-87c7-1baf93340cb7-lib-modules\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-cni-binary-copy\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.215890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.216560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.216093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-serviceca\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.217838 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.217817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-etc-tuned\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.217932 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.217918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8483c11-b065-4cdc-87c7-1baf93340cb7-tmp\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.224108 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.224083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/eaa4b0fc-eae2-4b87-82ca-39ea84c452c9-kube-api-access-vj8ct\") pod \"node-ca-5g7tv\" (UID: \"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9\") " pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.224688 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.224648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dt2z\" (UniqueName: \"kubernetes.io/projected/d324260d-db38-4bfb-8e21-bf894cd91a92-kube-api-access-5dt2z\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.224920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.224896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72wv\" (UniqueName: \"kubernetes.io/projected/2e2b88b3-1b07-4d05-9bcf-471cb7ae9066-kube-api-access-b72wv\") pod \"multus-additional-cni-plugins-fcklr\" (UID: \"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066\") " pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.225039 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.225015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxv4z\" (UniqueName: \"kubernetes.io/projected/dd029f5c-e4ce-4b5e-895f-00ff40ba63e6-kube-api-access-bxv4z\") pod \"aws-ebs-csi-driver-node-dfzfg\" (UID: \"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.226075 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.226054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6ms\" (UniqueName: \"kubernetes.io/projected/e8483c11-b065-4cdc-87c7-1baf93340cb7-kube-api-access-2f6ms\") pod \"tuned-r8mzr\" (UID: \"e8483c11-b065-4cdc-87c7-1baf93340cb7\") " pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.299227 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.299192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxkrj"
Jul 14 01:00:09.309446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.309420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qsk57"
Jul 14 01:00:09.319809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.319784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mw7kw"
Jul 14 01:00:09.325033 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.325011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:09.329815 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.329753    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45509e2a_8d8a_41ef_8ecf_a97334ac88c2.slice/crio-764688badcc05c69334713c72ffa547eaf92e799b0c24c47f6efba5e376fabfe WatchSource:0}: Error finding container 764688badcc05c69334713c72ffa547eaf92e799b0c24c47f6efba5e376fabfe: Status 404 returned error can't find the container with id 764688badcc05c69334713c72ffa547eaf92e799b0c24c47f6efba5e376fabfe
Jul 14 01:00:09.331060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.331043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:09.338925 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.338712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8mzr"
Jul 14 01:00:09.339416 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.339381    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55babe6b_803b_4816_9d0c_51071969dd69.slice/crio-0f7db52366bace081776c3a305569ca45b9a82b4171819d2b85959eab8357ae9 WatchSource:0}: Error finding container 0f7db52366bace081776c3a305569ca45b9a82b4171819d2b85959eab8357ae9: Status 404 returned error can't find the container with id 0f7db52366bace081776c3a305569ca45b9a82b4171819d2b85959eab8357ae9
Jul 14 01:00:09.344600 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.344576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5g7tv"
Jul 14 01:00:09.345796 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.345762    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dafbaf1_9368_458e_96ce_a7a1793b2a97.slice/crio-1ee44a0a75eea4d87a888ec1af77663e70b7814b79008e12d0c0666467f0a9d2 WatchSource:0}: Error finding container 1ee44a0a75eea4d87a888ec1af77663e70b7814b79008e12d0c0666467f0a9d2: Status 404 returned error can't find the container with id 1ee44a0a75eea4d87a888ec1af77663e70b7814b79008e12d0c0666467f0a9d2
Jul 14 01:00:09.351317 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.351101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg"
Jul 14 01:00:09.352201 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.352168    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8483c11_b065_4cdc_87c7_1baf93340cb7.slice/crio-f928e3ec67bd168924005276aad802731c513c94146d752eba13cf598a0f37ec WatchSource:0}: Error finding container f928e3ec67bd168924005276aad802731c513c94146d752eba13cf598a0f37ec: Status 404 returned error can't find the container with id f928e3ec67bd168924005276aad802731c513c94146d752eba13cf598a0f37ec
Jul 14 01:00:09.356622 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.356593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fcklr"
Jul 14 01:00:09.363398 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.363075    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa4b0fc_eae2_4b87_82ca_39ea84c452c9.slice/crio-3809bb19d88df62cedc914f38393c75c58abb667917500068bc8520fefcbcbd1 WatchSource:0}: Error finding container 3809bb19d88df62cedc914f38393c75c58abb667917500068bc8520fefcbcbd1: Status 404 returned error can't find the container with id 3809bb19d88df62cedc914f38393c75c58abb667917500068bc8520fefcbcbd1
Jul 14 01:00:09.370630 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:09.370605    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2b88b3_1b07_4d05_9bcf_471cb7ae9066.slice/crio-2d3a8cbe74e30021e162c9f8f82fe338780e67e08f6fe8e98ac9cc3bbb6a31cd WatchSource:0}: Error finding container 2d3a8cbe74e30021e162c9f8f82fe338780e67e08f6fe8e98ac9cc3bbb6a31cd: Status 404 returned error can't find the container with id 2d3a8cbe74e30021e162c9f8f82fe338780e67e08f6fe8e98ac9cc3bbb6a31cd
Jul 14 01:00:09.718878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.718790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:09.718878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.718839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:09.718899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.718955    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.718990    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719017    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719035    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:10.719006926 +0000 UTC m=+4.120318415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719042    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719051    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:09.719105 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719055    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:10.719044311 +0000 UTC m=+4.120355780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:09.719426 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:09.719113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:10.719095025 +0000 UTC m=+4.120406599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:10.042773 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.042692    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:55:09 +0000 UTC" deadline="2027-12-08 15:19:02.251482119 +0000 UTC"
Jul 14 01:00:10.042773 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.042726    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12302h18m52.208759322s"
Jul 14 01:00:10.165570 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.165384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:10.165724 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.165678    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:10.180268 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.180185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerStarted","Data":"2d3a8cbe74e30021e162c9f8f82fe338780e67e08f6fe8e98ac9cc3bbb6a31cd"}
Jul 14 01:00:10.182538 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.182415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"0f7db52366bace081776c3a305569ca45b9a82b4171819d2b85959eab8357ae9"}
Jul 14 01:00:10.185835 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.185808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw7kw" event={"ID":"45509e2a-8d8a-41ef-8ecf-a97334ac88c2","Type":"ContainerStarted","Data":"764688badcc05c69334713c72ffa547eaf92e799b0c24c47f6efba5e376fabfe"}
Jul 14 01:00:10.187230 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.187205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg" event={"ID":"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6","Type":"ContainerStarted","Data":"bd77e13b3a6b16ea0a879f32536bd485ce1beb8af452cad4b8d74e9b1af87b0a"}
Jul 14 01:00:10.189716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.189694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g7tv" event={"ID":"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9","Type":"ContainerStarted","Data":"3809bb19d88df62cedc914f38393c75c58abb667917500068bc8520fefcbcbd1"}
Jul 14 01:00:10.191139 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.191106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8mzr" event={"ID":"e8483c11-b065-4cdc-87c7-1baf93340cb7","Type":"ContainerStarted","Data":"f928e3ec67bd168924005276aad802731c513c94146d752eba13cf598a0f37ec"}
Jul 14 01:00:10.192762 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.192719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8ttzd" event={"ID":"3dafbaf1-9368-458e-96ce-a7a1793b2a97","Type":"ContainerStarted","Data":"1ee44a0a75eea4d87a888ec1af77663e70b7814b79008e12d0c0666467f0a9d2"}
Jul 14 01:00:10.194996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.194933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsk57" event={"ID":"0c96a14e-94d4-4016-882f-a62c7eeee44a","Type":"ContainerStarted","Data":"483b305fa36897cb5cc6eccb741fd2438175f169c4909987bbc1afad51b674b9"}
Jul 14 01:00:10.196295 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.196237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxkrj" event={"ID":"2b8164c2-4186-44a6-8c82-e9918e0b1408","Type":"ContainerStarted","Data":"ac22226571eac314fd77a979221c4cff710fc8a46aa92f98997c7f067875a995"}
Jul 14 01:00:10.726944 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.726906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:10.727132 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.726957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:10.727132 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:10.727005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:10.727220 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727136    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:10.727220 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727201    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:12.727182431 +0000 UTC m=+6.128493903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:10.727303 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727298    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:10.727340 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727308    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:10.727340 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727317    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:10.727400 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727342    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:12.727335338 +0000 UTC m=+6.128646806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:10.727400 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727383    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:10.727468 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:10.727402    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:12.727396352 +0000 UTC m=+6.128707820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:11.043436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:11.043299    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:55:09 +0000 UTC" deadline="2028-02-16 01:46:48.745074364 +0000 UTC"
Jul 14 01:00:11.043436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:11.043339    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13968h46m37.701740724s"
Jul 14 01:00:11.177669 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:11.174716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:11.177669 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:11.174922    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:11.177669 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:11.175272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:11.177669 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:11.175415    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:12.164677 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.164595    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:12.165238 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.164743    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:12.211144 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.211093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal" event={"ID":"54a8bec228f3c6b405de9447a5cd0448","Type":"ContainerStarted","Data":"889c2dd04d37816791edcb635a0e62e88ee5cf4c680b70f6ab60ea8a90024bee"}
Jul 14 01:00:12.216190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.216156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal" event={"ID":"4ce38b53631ed0051e61ec9c603fcaa4","Type":"ContainerStarted","Data":"01ba63091d6b837639805b030ba241f7df8766dd2c794035ae73c96d1bb7c96b"}
Jul 14 01:00:12.746898 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.746858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:12.747081 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.746914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:12.747081 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:12.746945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:12.747281 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747143    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:12.747281 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747218    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:16.747196133 +0000 UTC m=+10.148507615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:12.747657 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747633    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:12.747729 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747660    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:12.747729 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747674    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:12.747729 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747724    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:16.747707631 +0000 UTC m=+10.149019103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:12.747898 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747788    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:12.747898 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:12.747820    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:16.747808489 +0000 UTC m=+10.149119957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:13.167174 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:13.167082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:13.167599 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:13.167237    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:13.167599 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:13.167587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:13.167695 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:13.167671    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:14.164943 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:14.164912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:14.165140 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:14.165055    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:15.165297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:15.165222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:15.165663 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:15.165370    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:15.165663 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:15.165429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:15.165663 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:15.165543    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:16.165855 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.165328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:16.165855 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.165482    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:16.226934 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.226882    2565 generic.go:356] "Generic (PLEG): container finished" podID="54a8bec228f3c6b405de9447a5cd0448" containerID="889c2dd04d37816791edcb635a0e62e88ee5cf4c680b70f6ab60ea8a90024bee" exitCode=0
Jul 14 01:00:16.226934 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.226917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal" event={"ID":"54a8bec228f3c6b405de9447a5cd0448","Type":"ContainerDied","Data":"889c2dd04d37816791edcb635a0e62e88ee5cf4c680b70f6ab60ea8a90024bee"}
Jul 14 01:00:16.241113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.241061    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-153.ec2.internal" podStartSLOduration=8.241034333 podStartE2EDuration="8.241034333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:12.243659528 +0000 UTC m=+5.644971022" watchObservedRunningTime="2026-07-14 01:00:16.241034333 +0000 UTC m=+9.642345826"
Jul 14 01:00:16.777662 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.777623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:16.777662 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.777662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:16.777884 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:16.777693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:16.777884 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777790    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:16.777884 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777812    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:16.777884 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777837    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:16.777884 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777852    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:16.778039 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777838    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:24.777825222 +0000 UTC m=+18.179136691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:16.778039 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777918    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:24.777899473 +0000 UTC m=+18.179210952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:16.778039 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.777981    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:16.778039 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:16.778015    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:24.778003403 +0000 UTC m=+18.179314876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:17.166305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:17.165797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:17.166305 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:17.165905    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:17.166755 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:17.166371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:17.166755 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:17.166464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:18.164581 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:18.164546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:18.164770 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:18.164680    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:19.165219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:19.165187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:19.165638 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:19.165188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:19.165638 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:19.165336    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:19.165638 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:19.165386    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:20.164966 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:20.164925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:20.165114 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:20.165042    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:21.164738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:21.164702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:21.165215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:21.164750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:21.165215 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:21.164839    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:21.165215 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:21.164984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:22.164449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:22.164409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:22.164615 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:22.164583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:23.165281 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:23.165244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:23.165799 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:23.165387    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:23.165799 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:23.165435    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:23.165799 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:23.165556    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:24.164969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:24.164930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:24.165267 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.165063    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:24.843486 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:24.843446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:24.843497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:24.843533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843601    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843613    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843633    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843643    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843646    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843670    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:40.843649008 +0000 UTC m=+34.244960480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843694    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:40.843677633 +0000 UTC m=+34.244989157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:24.843942 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:24.843717    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:40.84370604 +0000 UTC m=+34.245017508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:25.164722 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:25.164647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:25.164859 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:25.164757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:25.164859 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:25.164810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:25.164934 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:25.164902    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:26.165041 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:26.165014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:26.165518 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:26.165159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:27.165196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:27.165149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:27.165642 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:27.165202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:27.165642 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:27.165278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:27.165642 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:27.165401    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:28.164467 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:28.164430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:28.164642 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:28.164552    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:29.164809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.164410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:29.165502 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:29.164890    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:29.165502 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.165033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:29.165502 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:29.165213    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:29.251468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.251437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg" event={"ID":"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6","Type":"ContainerStarted","Data":"021baa9cda984016d21ad54df870061075545bdbb77250c5efee7a473cd12f29"}
Jul 14 01:00:29.252878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.252853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5g7tv" event={"ID":"eaa4b0fc-eae2-4b87-82ca-39ea84c452c9","Type":"ContainerStarted","Data":"b656d8ac2be78d780c92f5c9198277ddfd4498db0955703dbbfe1bbec14d799e"}
Jul 14 01:00:29.254250 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.254226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8mzr" event={"ID":"e8483c11-b065-4cdc-87c7-1baf93340cb7","Type":"ContainerStarted","Data":"ecff02b140d49d382e010d1539220d48e30ab443ec90dbc61714d6500a54d47b"}
Jul 14 01:00:29.255565 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.255547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8ttzd" event={"ID":"3dafbaf1-9368-458e-96ce-a7a1793b2a97","Type":"ContainerStarted","Data":"01e425c58a9a2a1a486ffa2ed1afa5b0525321900d5783029dd157ab7f791da8"}
Jul 14 01:00:29.256825 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.256804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qsk57" event={"ID":"0c96a14e-94d4-4016-882f-a62c7eeee44a","Type":"ContainerStarted","Data":"cee0ad25fe64c0d1af1954182a38d45a90bd2ad41cf58e57bfdd2cde59317fbf"}
Jul 14 01:00:29.258107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.258089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxkrj" event={"ID":"2b8164c2-4186-44a6-8c82-e9918e0b1408","Type":"ContainerStarted","Data":"f1c3a800e29c815993ac13d2a94c17405dfb13b8d0161019317084d572b3e7d8"}
Jul 14 01:00:29.259815 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.259794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal" event={"ID":"54a8bec228f3c6b405de9447a5cd0448","Type":"ContainerStarted","Data":"9df21ad76a23312e1d8eb599fbd6911b2c1d29b3b4c3e46f6cc836cca4ebcf26"}
Jul 14 01:00:29.261081 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.261061    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="ba7e643dc7d3c4e60810a2b1865e678188957136ea06bab1d4206587c9acf6c2" exitCode=0
Jul 14 01:00:29.261180 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.261115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"ba7e643dc7d3c4e60810a2b1865e678188957136ea06bab1d4206587c9acf6c2"}
Jul 14 01:00:29.262917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.262902    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:00:29.263270 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.263250    2565 generic.go:356] "Generic (PLEG): container finished" podID="55babe6b-803b-4816-9d0c-51071969dd69" containerID="472ea43ecbfeafbdabd19a094679c46a0207a0b3201b5a41b38626b783a38e8f" exitCode=1
Jul 14 01:00:29.263358 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.263287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"4b016f92955004c7184be89d99e2570e35d9c40852139bfff476df077163c618"}
Jul 14 01:00:29.263358 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.263352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerDied","Data":"472ea43ecbfeafbdabd19a094679c46a0207a0b3201b5a41b38626b783a38e8f"}
Jul 14 01:00:29.263465 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.263406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"27bc064e7b6f6219518daf089677757775ffb8fceaf2b77502b94bc3d81a0a7d"}
Jul 14 01:00:29.267935 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.267898    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5g7tv" podStartSLOduration=2.846272589 podStartE2EDuration="22.267886633s" totalImagesPullingTime="19.421614044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.267463693 +0000 UTC m=+22.668775186" watchObservedRunningTime="2026-07-14 01:00:29.267886633 +0000 UTC m=+22.669198167"
Jul 14 01:00:29.283282 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.283243    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxkrj" podStartSLOduration=2.821120262 podStartE2EDuration="22.283231051s" totalImagesPullingTime="19.462110789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.283134427 +0000 UTC m=+22.684445914" watchObservedRunningTime="2026-07-14 01:00:29.283231051 +0000 UTC m=+22.684542542"
Jul 14 01:00:29.298208 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.298167    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qsk57" podStartSLOduration=2.782804419 podStartE2EDuration="22.29815233s" totalImagesPullingTime="19.515347911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.297805324 +0000 UTC m=+22.699116825" watchObservedRunningTime="2026-07-14 01:00:29.29815233 +0000 UTC m=+22.699463820"
Jul 14 01:00:29.312148 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.312095    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8ttzd" podStartSLOduration=3.034474998 podStartE2EDuration="22.312085542s" totalImagesPullingTime="19.277610544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.311889526 +0000 UTC m=+22.713201016" watchObservedRunningTime="2026-07-14 01:00:29.312085542 +0000 UTC m=+22.713397033"
Jul 14 01:00:29.343145 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.343092    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8mzr" podStartSLOduration=2.910857133 podStartE2EDuration="22.343077503s" totalImagesPullingTime="19.43222037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.34297558 +0000 UTC m=+22.744287071" watchObservedRunningTime="2026-07-14 01:00:29.343077503 +0000 UTC m=+22.744388993"
Jul 14 01:00:29.343241 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.343219    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-153.ec2.internal" podStartSLOduration=21.343213633 podStartE2EDuration="21.343213633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:29.324729852 +0000 UTC m=+22.726041343" watchObservedRunningTime="2026-07-14 01:00:29.343213633 +0000 UTC m=+22.744525121"
Jul 14 01:00:29.820355 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.820033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:29.820822 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:29.820801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:30.165437 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.165357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:30.165993 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:30.165475    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:30.268013 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.267930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mw7kw" event={"ID":"45509e2a-8d8a-41ef-8ecf-a97334ac88c2","Type":"ContainerStarted","Data":"24a7717b821e936a0c54981fc4fa757c8f8f7dea661bf7789035bfe19bd583d2"}
Jul 14 01:00:30.273882 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.273858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:00:30.274454 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.274422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"18e1df57bdc78f8a83e972b9b2c2d6e702b9c87667a7bbeb28ea218cec92ee0f"}
Jul 14 01:00:30.274549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.274532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"bdb6c13ffb28bc404390c90c5d1c6b2ffba82fe5fe4de83d8841056cf7664efc"}
Jul 14 01:00:30.274591 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.274582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"1e13fb1b673258a9c4159d57b273ef804908dc20c2caea782d3cbb8a80141ca5"}
Jul 14 01:00:30.275015 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.274994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:30.275259 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.275241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8ttzd"
Jul 14 01:00:30.283388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.283341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mw7kw" podStartSLOduration=3.831677224 podStartE2EDuration="23.283329242s" totalImagesPullingTime="19.451652018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:30.282972165 +0000 UTC m=+23.684283656" watchObservedRunningTime="2026-07-14 01:00:30.283329242 +0000 UTC m=+23.684640733"
Jul 14 01:00:30.451463 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:30.451435    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 01:00:31.082887 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.082770    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T01:00:30.451457782Z","UUID":"811b1ee7-d16f-43a8-a499-c86ad3755be5","Handler":null,"Name":"","Endpoint":""}
Jul 14 01:00:31.084665 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.084637    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 01:00:31.084800 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.084684    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 01:00:31.165140 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.165101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:31.165318 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:31.165248    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:31.165550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.165101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:31.165949 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:31.165613    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:31.278953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:31.278918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg" event={"ID":"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6","Type":"ContainerStarted","Data":"dc175539b7744287c61f660523cd9a3584340e2f227b8afae47946de7603a7e4"}
Jul 14 01:00:32.164909 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:32.164682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:32.165103 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:32.164965    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:32.285420 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:32.285395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:00:32.285941 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:32.285835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"378d81f026470e2d0c2d680f9e46eadbc7b970cc925c0b9396742f04aa23665d"}
Jul 14 01:00:32.288113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:32.288086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg" event={"ID":"dd029f5c-e4ce-4b5e-895f-00ff40ba63e6","Type":"ContainerStarted","Data":"cf9dfc7c0b0060aad2d5a0f29bc3eefeb937b15ccc3e776fc700ebac3f231845"}
Jul 14 01:00:32.304979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:32.304931    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dfzfg" podStartSLOduration=3.227468792 podStartE2EDuration="25.304914998s" totalImagesPullingTime="22.077446206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:32.304556087 +0000 UTC m=+25.705867577" watchObservedRunningTime="2026-07-14 01:00:32.304914998 +0000 UTC m=+25.706226489"
Jul 14 01:00:33.165108 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:33.165068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:33.165437 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:33.165231    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:33.165437 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:33.165307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:33.165437 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:33.165425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:34.164990 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.164804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:34.165790 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:34.165090    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:34.293858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.293825    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="0733a99284b7377bc92017f11194dc1c127d73c431576bdb4e91e5b4a6e48955" exitCode=0
Jul 14 01:00:34.294023 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.293907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"0733a99284b7377bc92017f11194dc1c127d73c431576bdb4e91e5b4a6e48955"}
Jul 14 01:00:34.297305 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.297289    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:00:34.297695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.297671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"57d484fdba8ca045d25a482f35a6429e7a22e05eb2e7924a659fd6860fc8934c"}
Jul 14 01:00:34.297965 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.297940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:34.298048 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.297994    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:34.298048 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.298024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:34.298173 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.298148    2565 scope.go:117] "RemoveContainer" containerID="472ea43ecbfeafbdabd19a094679c46a0207a0b3201b5a41b38626b783a38e8f"
Jul 14 01:00:34.314606 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.314585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:34.315256 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:34.315239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:00:35.165301 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.165181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:35.165301 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.165213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:35.165301 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:35.165294    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:35.166498 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:35.165376    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:35.303343 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.303319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:00:35.303725 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.303696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" event={"ID":"55babe6b-803b-4816-9d0c-51071969dd69","Type":"ContainerStarted","Data":"a449449546fb8f2cffad47f17234dc4dc5c84ddf1e1b2c0161b36fd7587dfa78"}
Jul 14 01:00:35.329885 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.329371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl" podStartSLOduration=8.795148245 podStartE2EDuration="28.32935077s" totalImagesPullingTime="19.534202525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:35.327209126 +0000 UTC m=+28.728520618" watchObservedRunningTime="2026-07-14 01:00:35.32935077 +0000 UTC m=+28.730662261"
Jul 14 01:00:35.702802 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.702726    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9mpz2"]
Jul 14 01:00:35.703017 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.702848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:35.703017 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:35.702939    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:35.705000 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.704965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2f7j6"]
Jul 14 01:00:35.705140 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.705072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:35.705200 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:35.705183    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:35.715258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.715235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htw8v"]
Jul 14 01:00:35.715389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:35.715337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:35.715508 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:35.715477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:36.308296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:36.308094    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="6da7c2c0262230fb90fe0f003b04c59eb7a68fbfcf4b0fc46138e64a2c441d21" exitCode=0
Jul 14 01:00:36.308762 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:36.308185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"6da7c2c0262230fb90fe0f003b04c59eb7a68fbfcf4b0fc46138e64a2c441d21"}
Jul 14 01:00:37.167476 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:37.167439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:37.167817 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:37.167759    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:37.168468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:37.168443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:37.168667 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:37.168643    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:37.168739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:37.168715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:37.168869 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:37.168846    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:38.315708 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:38.315678    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="7ab39b3fe9076f95285a4e7cd2e8141634b75ea08b6f9869833c767861abce6d" exitCode=0
Jul 14 01:00:38.316475 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:38.315732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"7ab39b3fe9076f95285a4e7cd2e8141634b75ea08b6f9869833c767861abce6d"}
Jul 14 01:00:39.165103 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:39.165075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:39.165302 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:39.165074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:39.165302 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:39.165218    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:39.165302 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:39.165087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:39.165302 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:39.165267    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:39.165443 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:39.165331    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:40.859803 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:40.859761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:40.859851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:40.859883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.859971    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.859980    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860049    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860057    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:01:12.860037198 +0000 UTC m=+66.261348678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860069    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret podName:5b6eb8c7-8e78-42d8-ac58-c7e731c89583 nodeName:}" failed. No retries permitted until 2026-07-14 01:01:12.860069648 +0000 UTC m=+66.261381117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret") pod "global-pull-secret-syncer-htw8v" (UID: "5b6eb8c7-8e78-42d8-ac58-c7e731c89583") : object "kube-system"/"original-pull-secret" not registered
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860082    2565 projected.go:196] Error preparing data for projected volume kube-api-access-c8wfv for pod openshift-network-diagnostics/network-check-target-9mpz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:40.860374 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:40.860173    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv podName:39151eb5-8500-441a-a48e-6b15937a3bc3 nodeName:}" failed. No retries permitted until 2026-07-14 01:01:12.860158406 +0000 UTC m=+66.261469888 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c8wfv" (UniqueName: "kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv") pod "network-check-target-9mpz2" (UID: "39151eb5-8500-441a-a48e-6b15937a3bc3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 01:00:41.164904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.164820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:41.165066 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.164820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:41.165066 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:41.164966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-htw8v" podUID="5b6eb8c7-8e78-42d8-ac58-c7e731c89583"
Jul 14 01:00:41.165066 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.164820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:41.165066 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:41.165027    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:00:41.165304 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:41.165111    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9mpz2" podUID="39151eb5-8500-441a-a48e-6b15937a3bc3"
Jul 14 01:00:41.399245 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.399212    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-153.ec2.internal" event="NodeReady"
Jul 14 01:00:41.399391 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.399362    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 01:00:41.439637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.439558    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xv6xw"]
Jul 14 01:00:41.442237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.442214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.442374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.442253    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l9lzv"]
Jul 14 01:00:41.444057 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.444039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.444741 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.444717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 01:00:41.444851 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.444824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 01:00:41.444969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.444885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jf2dk\""
Jul 14 01:00:41.446340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.446318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 01:00:41.446545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.446507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 01:00:41.446639 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.446582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qwwjg\""
Jul 14 01:00:41.446929 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.446913    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 01:00:41.451276 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.451253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xv6xw"]
Jul 14 01:00:41.454257 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.454235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9lzv"]
Jul 14 01:00:41.565933 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.565895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/b883267b-d699-4506-9721-2df37880c63c-kube-api-access-kq45g\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.566148 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.565935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-cert\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.566148 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.566025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b883267b-d699-4506-9721-2df37880c63c-tmp-dir\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.566280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.566148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.566280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.566195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b883267b-d699-4506-9721-2df37880c63c-config-volume\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.566280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.566231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2gdt\" (UniqueName: \"kubernetes.io/projected/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-kube-api-access-f2gdt\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.666862 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.666827    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b883267b-d699-4506-9721-2df37880c63c-config-volume\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.666862 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.666869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2gdt\" (UniqueName: \"kubernetes.io/projected/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-kube-api-access-f2gdt\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.667115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.666913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/b883267b-d699-4506-9721-2df37880c63c-kube-api-access-kq45g\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.667115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.666937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-cert\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.667115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.666959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b883267b-d699-4506-9721-2df37880c63c-tmp-dir\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.667115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.667019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.667322 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:41.667223    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:41.667322 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:41.667293    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:00:42.167274479 +0000 UTC m=+35.568585969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:00:41.667448 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.667364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b883267b-d699-4506-9721-2df37880c63c-tmp-dir\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.667636 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.667611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b883267b-d699-4506-9721-2df37880c63c-config-volume\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.672264 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.672102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-cert\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.678938 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.678912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq45g\" (UniqueName: \"kubernetes.io/projected/b883267b-d699-4506-9721-2df37880c63c-kube-api-access-kq45g\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:41.681712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.681685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2gdt\" (UniqueName: \"kubernetes.io/projected/e55a38c3-eb9c-4d7b-9eb4-65a775e03812-kube-api-access-f2gdt\") pod \"ingress-canary-l9lzv\" (UID: \"e55a38c3-eb9c-4d7b-9eb4-65a775e03812\") " pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:41.762005 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:41.761887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l9lzv"
Jul 14 01:00:42.171504 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:42.171453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:42.171936 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:42.171618    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:42.171936 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:42.171690    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:00:43.171674638 +0000 UTC m=+36.572986106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:00:42.829886 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:42.829778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l9lzv"]
Jul 14 01:00:42.834912 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:00:42.834883    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55a38c3_eb9c_4d7b_9eb4_65a775e03812.slice/crio-6167b75236804c4cb335c8dda5f0099434db808ccd8633b1cfd1ff1f31ce4c91 WatchSource:0}: Error finding container 6167b75236804c4cb335c8dda5f0099434db808ccd8633b1cfd1ff1f31ce4c91: Status 404 returned error can't find the container with id 6167b75236804c4cb335c8dda5f0099434db808ccd8633b1cfd1ff1f31ce4c91
Jul 14 01:00:43.164826 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.164786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:00:43.164996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.164786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:00:43.164996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.164936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:00:43.168368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.167946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 01:00:43.168368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.168262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 01:00:43.169457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.169299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6f2s8\""
Jul 14 01:00:43.169457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.169307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 01:00:43.169457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.169304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 01:00:43.169457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.169374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2php\""
Jul 14 01:00:43.178656 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.178632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:43.178984 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:43.178731    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:43.178984 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:43.178785    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:00:45.178768084 +0000 UTC m=+38.580079553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:00:43.330978 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.330941    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="544bb82eb088e9e4583d7f770d044818bbe7a0a3c9bb25faa910c6108051fc1e" exitCode=0
Jul 14 01:00:43.331151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.331017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"544bb82eb088e9e4583d7f770d044818bbe7a0a3c9bb25faa910c6108051fc1e"}
Jul 14 01:00:43.332218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:43.332197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9lzv" event={"ID":"e55a38c3-eb9c-4d7b-9eb4-65a775e03812","Type":"ContainerStarted","Data":"6167b75236804c4cb335c8dda5f0099434db808ccd8633b1cfd1ff1f31ce4c91"}
Jul 14 01:00:44.339426 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:44.338503    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2b88b3-1b07-4d05-9bcf-471cb7ae9066" containerID="a0ed33f08900452a35874a3129364ddd41779c50249784339c32114a108385a3" exitCode=0
Jul 14 01:00:44.339426 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:44.338569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerDied","Data":"a0ed33f08900452a35874a3129364ddd41779c50249784339c32114a108385a3"}
Jul 14 01:00:45.194711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:45.194663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:45.194904 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:45.194825    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:45.194965 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:45.194907    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:00:49.194886553 +0000 UTC m=+42.596198025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:00:45.345093 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:45.345057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fcklr" event={"ID":"2e2b88b3-1b07-4d05-9bcf-471cb7ae9066","Type":"ContainerStarted","Data":"a6629eaac7122bba5cbcfc6840e7e67dcd321eda085c1c9e32c90939b67c9d46"}
Jul 14 01:00:45.367187 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:45.367143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fcklr" podStartSLOduration=7.990106816 podStartE2EDuration="38.36710358s" totalImagesPullingTime="30.376996764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:45.365416712 +0000 UTC m=+38.766728202" watchObservedRunningTime="2026-07-14 01:00:45.36710358 +0000 UTC m=+38.768415072"
Jul 14 01:00:46.349011 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:46.348913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l9lzv" event={"ID":"e55a38c3-eb9c-4d7b-9eb4-65a775e03812","Type":"ContainerStarted","Data":"35ed74352eec0f6ec4f940b9e116b05fb22f2a31a7bba756e59ec2a9accb54ae"}
Jul 14 01:00:46.363632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:46.363589    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l9lzv" podStartSLOduration=2.14435232 podStartE2EDuration="5.363573606s" totalImagesPullingTime="3.219221286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:46.362305565 +0000 UTC m=+39.763617055" watchObservedRunningTime="2026-07-14 01:00:46.363573606 +0000 UTC m=+39.764885097"
Jul 14 01:00:49.227581 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:49.227533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:49.227956 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:49.227665    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:49.227956 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:49.227718    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:00:57.227704513 +0000 UTC m=+50.629015981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:00:57.285626 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:00:57.285587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:00:57.286084 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:57.285713    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:00:57.286084 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:00:57.285772    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:01:13.285757363 +0000 UTC m=+66.687068832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:01:06.319473 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:06.319443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmcbl"
Jul 14 01:01:12.886950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.886904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:01:12.886950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.886946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:01:12.887497 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.886971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:01:12.889862 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.889836    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 01:01:12.889980 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.889842    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 01:01:12.889980 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.889843    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 01:01:12.897725 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:12.897703    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 01:01:12.897814 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:12.897777    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:02:16.897755358 +0000 UTC m=+130.299066847 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : secret "metrics-daemon-secret" not found
Jul 14 01:01:12.899823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.899804    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 01:01:12.901423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.901404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5b6eb8c7-8e78-42d8-ac58-c7e731c89583-original-pull-secret\") pod \"global-pull-secret-syncer-htw8v\" (UID: \"5b6eb8c7-8e78-42d8-ac58-c7e731c89583\") " pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:01:12.910737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:12.910714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8wfv\" (UniqueName: \"kubernetes.io/projected/39151eb5-8500-441a-a48e-6b15937a3bc3-kube-api-access-c8wfv\") pod \"network-check-target-9mpz2\" (UID: \"39151eb5-8500-441a-a48e-6b15937a3bc3\") " pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:01:13.182878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.182790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-htw8v"
Jul 14 01:01:13.191142 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.191094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2php\""
Jul 14 01:01:13.197912 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.197889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:01:13.290881 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.290834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:01:13.291183 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:13.291021    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:01:13.291183 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:13.291154    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:01:45.291095162 +0000 UTC m=+98.692406637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:01:13.319624 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.319588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-htw8v"]
Jul 14 01:01:13.323203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:01:13.323166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6eb8c7_8e78_42d8_ac58_c7e731c89583.slice/crio-92cdb6c279099acb8395ebc12cfc95a240536852bf411c7439bd667498778c08 WatchSource:0}: Error finding container 92cdb6c279099acb8395ebc12cfc95a240536852bf411c7439bd667498778c08: Status 404 returned error can't find the container with id 92cdb6c279099acb8395ebc12cfc95a240536852bf411c7439bd667498778c08
Jul 14 01:01:13.336316 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.336292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9mpz2"]
Jul 14 01:01:13.339266 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:01:13.339238    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39151eb5_8500_441a_a48e_6b15937a3bc3.slice/crio-7cf4c4167fd5477e2472fd57a2d8a623f206b81c95e98c6886fd26e099ac6c1e WatchSource:0}: Error finding container 7cf4c4167fd5477e2472fd57a2d8a623f206b81c95e98c6886fd26e099ac6c1e: Status 404 returned error can't find the container with id 7cf4c4167fd5477e2472fd57a2d8a623f206b81c95e98c6886fd26e099ac6c1e
Jul 14 01:01:13.414365 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.414335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9mpz2" event={"ID":"39151eb5-8500-441a-a48e-6b15937a3bc3","Type":"ContainerStarted","Data":"7cf4c4167fd5477e2472fd57a2d8a623f206b81c95e98c6886fd26e099ac6c1e"}
Jul 14 01:01:13.415447 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:13.415427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htw8v" event={"ID":"5b6eb8c7-8e78-42d8-ac58-c7e731c89583","Type":"ContainerStarted","Data":"92cdb6c279099acb8395ebc12cfc95a240536852bf411c7439bd667498778c08"}
Jul 14 01:01:18.428996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:18.428914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9mpz2" event={"ID":"39151eb5-8500-441a-a48e-6b15937a3bc3","Type":"ContainerStarted","Data":"71409890251caff4982166f0c41ef907cd8d5c423bb210b7c0e405ca7f9476ca"}
Jul 14 01:01:18.429502 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:18.429039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:01:18.430487 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:18.430462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-htw8v" event={"ID":"5b6eb8c7-8e78-42d8-ac58-c7e731c89583","Type":"ContainerStarted","Data":"cfd48526a1aaffe760afb78073abb17341c392921dee0c0599ab59ced731c9e8"}
Jul 14 01:01:18.444050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:18.444002    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9mpz2" podStartSLOduration=66.711265748 podStartE2EDuration="1m11.443985391s" totalImagesPullingTime="4.732719643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:18.443382998 +0000 UTC m=+71.844694488" watchObservedRunningTime="2026-07-14 01:01:18.443985391 +0000 UTC m=+71.845296860"
Jul 14 01:01:18.459082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:18.459037    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-htw8v" podStartSLOduration=66.706979541 podStartE2EDuration="1m11.459021656s" totalImagesPullingTime="4.752042115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:18.458666498 +0000 UTC m=+71.859977990" watchObservedRunningTime="2026-07-14 01:01:18.459021656 +0000 UTC m=+71.860333147"
Jul 14 01:01:45.298827 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:45.298788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:01:45.299166 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:45.298907    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:01:45.299166 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:01:45.298967    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:02:49.298953542 +0000 UTC m=+162.700265011 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:01:49.435601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:01:49.435568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9mpz2"
Jul 14 01:02:02.620404 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.620370    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"]
Jul 14 01:02:02.622274 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.622257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.624723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.624697    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 01:02:02.624872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.624725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 01:02:02.625754 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.625730    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 01:02:02.625872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.625768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 01:02:02.625872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.625777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 01:02:02.625872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.625795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 01:02:02.626083 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.626059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 01:02:02.633667 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.633648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"]
Jul 14 01:02:02.717044 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.717044 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab4126f-73d5-4bb1-983a-ad45d60dd050-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.717293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.717293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.717293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.717293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.717196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v847k\" (UniqueName: \"kubernetes.io/projected/0ab4126f-73d5-4bb1-983a-ad45d60dd050-kube-api-access-v847k\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818469 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab4126f-73d5-4bb1-983a-ad45d60dd050-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818561 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818561 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818561 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818561 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v847k\" (UniqueName: \"kubernetes.io/projected/0ab4126f-73d5-4bb1-983a-ad45d60dd050-kube-api-access-v847k\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.818748 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.818595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.819258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.819226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ab4126f-73d5-4bb1-983a-ad45d60dd050-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.821281 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.821256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.821391 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.821309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-ca\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.821466 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.821452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.821527 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.821505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ab4126f-73d5-4bb1-983a-ad45d60dd050-hub\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.834018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.833989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v847k\" (UniqueName: \"kubernetes.io/projected/0ab4126f-73d5-4bb1-983a-ad45d60dd050-kube-api-access-v847k\") pod \"cluster-proxy-proxy-agent-664cdd94d5-7874f\" (UID: \"0ab4126f-73d5-4bb1-983a-ad45d60dd050\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:02.940177 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:02.940068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:02:03.065372 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:03.065341    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"]
Jul 14 01:02:03.068822 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:02:03.068799    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ab4126f_73d5_4bb1_983a_ad45d60dd050.slice/crio-108dda12c5b43dba2f8727f3fbeeb858a9f2bbba79877a2080b9fc7bfa2f4c3e WatchSource:0}: Error finding container 108dda12c5b43dba2f8727f3fbeeb858a9f2bbba79877a2080b9fc7bfa2f4c3e: Status 404 returned error can't find the container with id 108dda12c5b43dba2f8727f3fbeeb858a9f2bbba79877a2080b9fc7bfa2f4c3e
Jul 14 01:02:03.536805 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:03.536771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerStarted","Data":"108dda12c5b43dba2f8727f3fbeeb858a9f2bbba79877a2080b9fc7bfa2f4c3e"}
Jul 14 01:02:12.562544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:12.562505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerStarted","Data":"0d509aaa9306e61bba1bd6ac9e2b02090daad105edfe89435d79926fa645c2fe"}
Jul 14 01:02:12.562920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:12.562556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerStarted","Data":"16249c87438896fed011686b2427884b6af2a0a69503600f6039e94351855623"}
Jul 14 01:02:12.562920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:12.562577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerStarted","Data":"8d9270679ec790f6e69cae9a7443c20ea4a16563ec4f410c5e68f7fe1d84aa02"}
Jul 14 01:02:12.580986 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:12.580940    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" podStartSLOduration=1.604683638 podStartE2EDuration="10.580923476s" totalImagesPullingTime="8.976239838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:02:12.579835977 +0000 UTC m=+125.981147494" watchObservedRunningTime="2026-07-14 01:02:12.580923476 +0000 UTC m=+125.982234966"
Jul 14 01:02:16.920745 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:16.920694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:02:16.921175 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:16.920824    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 01:02:16.921175 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:16.920882    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs podName:d324260d-db38-4bfb-8e21-bf894cd91a92 nodeName:}" failed. No retries permitted until 2026-07-14 01:04:18.920865746 +0000 UTC m=+252.322177215 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs") pod "network-metrics-daemon-2f7j6" (UID: "d324260d-db38-4bfb-8e21-bf894cd91a92") : secret "metrics-daemon-secret" not found
Jul 14 01:02:44.456752 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:44.456701    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xv6xw" podUID="b883267b-d699-4506-9721-2df37880c63c"
Jul 14 01:02:44.651814 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:44.651788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:02:46.176952 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:46.176908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2f7j6" podUID="d324260d-db38-4bfb-8e21-bf894cd91a92"
Jul 14 01:02:49.337161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:02:49.337102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:02:49.337551 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:49.337257    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 01:02:49.337551 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:02:49.337323    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls podName:b883267b-d699-4506-9721-2df37880c63c nodeName:}" failed. No retries permitted until 2026-07-14 01:04:51.337306061 +0000 UTC m=+284.738617530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls") pod "dns-default-xv6xw" (UID: "b883267b-d699-4506-9721-2df37880c63c") : secret "dns-default-metrics-tls" not found
Jul 14 01:03:00.165386 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:00.165302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:03:47.606236 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.606199    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-x822p"]
Jul 14 01:03:47.607986 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.607971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.611082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.611040    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 01:03:47.611225 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.611144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 01:03:47.611409 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.611388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 01:03:47.611644 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.611627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 01:03:47.612204 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.612188    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lpgpp\""
Jul 14 01:03:47.630759 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.630739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-config\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.630860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.630781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-trusted-ca\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.630860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.630818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7c15590-6880-4f4f-92c9-39e078e1c125-serving-cert\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.630860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.630840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnl9v\" (UniqueName: \"kubernetes.io/projected/b7c15590-6880-4f4f-92c9-39e078e1c125-kube-api-access-dnl9v\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.630959 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.630855    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 01:03:47.636261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.636240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-x822p"]
Jul 14 01:03:47.732009 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.731977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7c15590-6880-4f4f-92c9-39e078e1c125-serving-cert\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.732009 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.732007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnl9v\" (UniqueName: \"kubernetes.io/projected/b7c15590-6880-4f4f-92c9-39e078e1c125-kube-api-access-dnl9v\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.732231 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.732067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-config\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.732231 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.732112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-trusted-ca\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.733061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.733037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-trusted-ca\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.733179 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.733037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7c15590-6880-4f4f-92c9-39e078e1c125-config\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.734549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.734529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7c15590-6880-4f4f-92c9-39e078e1c125-serving-cert\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.740432 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.740410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnl9v\" (UniqueName: \"kubernetes.io/projected/b7c15590-6880-4f4f-92c9-39e078e1c125-kube-api-access-dnl9v\") pod \"console-operator-7866497494-x822p\" (UID: \"b7c15590-6880-4f4f-92c9-39e078e1c125\") " pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:47.917202 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:47.917069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:48.036813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:48.036785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-x822p"]
Jul 14 01:03:48.040681 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:03:48.040653    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c15590_6880_4f4f_92c9_39e078e1c125.slice/crio-ba325ddc6005ce62773d819b137f274bbb1b700d00fe79c98da236d6a9f7b8ea WatchSource:0}: Error finding container ba325ddc6005ce62773d819b137f274bbb1b700d00fe79c98da236d6a9f7b8ea: Status 404 returned error can't find the container with id ba325ddc6005ce62773d819b137f274bbb1b700d00fe79c98da236d6a9f7b8ea
Jul 14 01:03:48.831364 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:48.831331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x822p" event={"ID":"b7c15590-6880-4f4f-92c9-39e078e1c125","Type":"ContainerStarted","Data":"ba325ddc6005ce62773d819b137f274bbb1b700d00fe79c98da236d6a9f7b8ea"}
Jul 14 01:03:50.839618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:50.839539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/0.log"
Jul 14 01:03:50.839618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:50.839588    2565 generic.go:356] "Generic (PLEG): container finished" podID="b7c15590-6880-4f4f-92c9-39e078e1c125" containerID="0ea06c60f1d282ce382ce2ed5a5650fed0fad1b7308302d12487373db3be6fe2" exitCode=255
Jul 14 01:03:50.839991 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:50.839636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x822p" event={"ID":"b7c15590-6880-4f4f-92c9-39e078e1c125","Type":"ContainerDied","Data":"0ea06c60f1d282ce382ce2ed5a5650fed0fad1b7308302d12487373db3be6fe2"}
Jul 14 01:03:50.839991 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:50.839854    2565 scope.go:117] "RemoveContainer" containerID="0ea06c60f1d282ce382ce2ed5a5650fed0fad1b7308302d12487373db3be6fe2"
Jul 14 01:03:51.844261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.844236    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/1.log"
Jul 14 01:03:51.844709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.844631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/0.log"
Jul 14 01:03:51.844709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.844671    2565 generic.go:356] "Generic (PLEG): container finished" podID="b7c15590-6880-4f4f-92c9-39e078e1c125" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77" exitCode=255
Jul 14 01:03:51.844818 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.844750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x822p" event={"ID":"b7c15590-6880-4f4f-92c9-39e078e1c125","Type":"ContainerDied","Data":"49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"}
Jul 14 01:03:51.844818 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.844804    2565 scope.go:117] "RemoveContainer" containerID="0ea06c60f1d282ce382ce2ed5a5650fed0fad1b7308302d12487373db3be6fe2"
Jul 14 01:03:51.845104 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:51.845085    2565 scope.go:117] "RemoveContainer" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"
Jul 14 01:03:51.845298 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:51.845278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x822p_openshift-console-operator(b7c15590-6880-4f4f-92c9-39e078e1c125)\"" pod="openshift-console-operator/console-operator-7866497494-x822p" podUID="b7c15590-6880-4f4f-92c9-39e078e1c125"
Jul 14 01:03:52.849176 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.849150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/1.log"
Jul 14 01:03:52.849565 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.849470    2565 scope.go:117] "RemoveContainer" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"
Jul 14 01:03:52.849623 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:52.849605    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x822p_openshift-console-operator(b7c15590-6880-4f4f-92c9-39e078e1c125)\"" pod="openshift-console-operator/console-operator-7866497494-x822p" podUID="b7c15590-6880-4f4f-92c9-39e078e1c125"
Jul 14 01:03:52.885130 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.885103    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9nksx"]
Jul 14 01:03:52.887707 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.887692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:52.889995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.889975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 01:03:52.890088 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.889974    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 01:03:52.890304 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.890273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfczl\""
Jul 14 01:03:52.890506 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.890492    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 01:03:52.890700 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.890685    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 01:03:52.900185 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.900166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nksx"]
Jul 14 01:03:52.968826 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.968796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:52.968991 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.968837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:52.968991 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.968862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-data-volume\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:52.969074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.969059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-crio-socket\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:52.969142 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:52.969084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22gn\" (UniqueName: \"kubernetes.io/projected/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-api-access-w22gn\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.069988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-data-volume\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-crio-socket\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22gn\" (UniqueName: \"kubernetes.io/projected/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-api-access-w22gn\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070196 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.070117    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 01:03:53.070394 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-crio-socket\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.070394 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.070227    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:53.570211863 +0000 UTC m=+226.971523331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : configmap "kube-rbac-proxy" not found
Jul 14 01:03:53.070394 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.070155    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:53.070394 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.070289    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:53.570275254 +0000 UTC m=+226.971586724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:53.070563 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.070436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-data-volume\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.079898 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.079249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22gn\" (UniqueName: \"kubernetes.io/projected/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-api-access-w22gn\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.573207 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.573153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.573389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:53.573227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:53.573389 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.573300    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:53.573389 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.573362    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:54.573348139 +0000 UTC m=+227.974659608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:53.573389 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.573363    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 01:03:53.573530 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:53.573419    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:54.573405313 +0000 UTC m=+227.974716785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : configmap "kube-rbac-proxy" not found
Jul 14 01:03:54.580756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:54.580713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:54.580756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:54.580756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:54.581192 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:54.580868    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 01:03:54.581192 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:54.580869    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:54.581192 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:54.580925    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:56.580908796 +0000 UTC m=+229.982220277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : configmap "kube-rbac-proxy" not found
Jul 14 01:03:54.581192 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:54.580939    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:03:56.580933249 +0000 UTC m=+229.982244719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:55.068780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:55.068747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxkrj_2b8164c2-4186-44a6-8c82-e9918e0b1408/dns-node-resolver/0.log"
Jul 14 01:03:55.668406 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:55.668380    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g7tv_eaa4b0fc-eae2-4b87-82ca-39ea84c452c9/node-ca/0.log"
Jul 14 01:03:56.594518 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:56.594463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:56.594518 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:56.594520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:03:56.594735 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:56.594619    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 01:03:56.594735 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:56.594628    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:56.594735 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:56.594682    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:04:00.59466812 +0000 UTC m=+233.995979589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : configmap "kube-rbac-proxy" not found
Jul 14 01:03:56.594735 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:56.594696    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:04:00.59468962 +0000 UTC m=+233.996001088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : secret "insights-runtime-extractor-tls" not found
Jul 14 01:03:56.869026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:56.868948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9lzv_e55a38c3-eb9c-4d7b-9eb4-65a775e03812/serve-healthcheck-canary/0.log"
Jul 14 01:03:57.917639 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:57.917601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:57.918024 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:57.917671    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:03:57.918024 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:03:57.917972    2565 scope.go:117] "RemoveContainer" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"
Jul 14 01:03:57.918118 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:03:57.918099    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-x822p_openshift-console-operator(b7c15590-6880-4f4f-92c9-39e078e1c125)\"" pod="openshift-console-operator/console-operator-7866497494-x822p" podUID="b7c15590-6880-4f4f-92c9-39e078e1c125"
Jul 14 01:04:00.627260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:00.627219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:00.627260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:00.627260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:00.627697 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:00.627330    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 01:04:00.627697 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:00.627367    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 01:04:00.627697 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:00.627382    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:04:08.627368402 +0000 UTC m=+242.028679871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : configmap "kube-rbac-proxy" not found
Jul 14 01:04:00.627697 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:00.627421    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls podName:aae0ac19-e3d4-41b3-b3d8-271fe15ffde3 nodeName:}" failed. No retries permitted until 2026-07-14 01:04:08.627404793 +0000 UTC m=+242.028716261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9nksx" (UID: "aae0ac19-e3d4-41b3-b3d8-271fe15ffde3") : secret "insights-runtime-extractor-tls" not found
Jul 14 01:04:08.682686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.682644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:08.682686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.682691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:08.683325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.683308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:08.685090 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.685070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aae0ac19-e3d4-41b3-b3d8-271fe15ffde3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nksx\" (UID: \"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3\") " pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:08.798908 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.798864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfczl\""
Jul 14 01:04:08.806860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.806835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nksx"
Jul 14 01:04:08.931020 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:08.930990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nksx"]
Jul 14 01:04:08.933997 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:08.933941    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae0ac19_e3d4_41b3_b3d8_271fe15ffde3.slice/crio-fb31d5c1d78f98a4393cebfa1c438c9d1e52d16e43c4a7a2fb0adfbbf068ade7 WatchSource:0}: Error finding container fb31d5c1d78f98a4393cebfa1c438c9d1e52d16e43c4a7a2fb0adfbbf068ade7: Status 404 returned error can't find the container with id fb31d5c1d78f98a4393cebfa1c438c9d1e52d16e43c4a7a2fb0adfbbf068ade7
Jul 14 01:04:09.164823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.164796    2565 scope.go:117] "RemoveContainer" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"
Jul 14 01:04:09.898994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.898903    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:04:09.899963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.899940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/1.log"
Jul 14 01:04:09.900107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.899987    2565 generic.go:356] "Generic (PLEG): container finished" podID="b7c15590-6880-4f4f-92c9-39e078e1c125" containerID="91247a0f4d770d2c86110fb836a1009663941cfc5e62617299c055dd429312cd" exitCode=255
Jul 14 01:04:09.900107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.900072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x822p" event={"ID":"b7c15590-6880-4f4f-92c9-39e078e1c125","Type":"ContainerDied","Data":"91247a0f4d770d2c86110fb836a1009663941cfc5e62617299c055dd429312cd"}
Jul 14 01:04:09.900256 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.900155    2565 scope.go:117] "RemoveContainer" containerID="49846758ea5d7d65743e2b7b8e8d593f393c9993612780c3abf2474761b30e77"
Jul 14 01:04:09.901082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.900689    2565 scope.go:117] "RemoveContainer" containerID="91247a0f4d770d2c86110fb836a1009663941cfc5e62617299c055dd429312cd"
Jul 14 01:04:09.901082 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:09.900886    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-x822p_openshift-console-operator(b7c15590-6880-4f4f-92c9-39e078e1c125)\"" pod="openshift-console-operator/console-operator-7866497494-x822p" podUID="b7c15590-6880-4f4f-92c9-39e078e1c125"
Jul 14 01:04:09.901730 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:09.901399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nksx" event={"ID":"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3","Type":"ContainerStarted","Data":"fb31d5c1d78f98a4393cebfa1c438c9d1e52d16e43c4a7a2fb0adfbbf068ade7"}
Jul 14 01:04:10.906521 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:10.906491    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:04:12.913234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:12.913142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nksx" event={"ID":"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3","Type":"ContainerStarted","Data":"a0cdda2d5380a831e26145134ba4ae93bdaf39b1baad97e485ddc6c55e60ddab"}
Jul 14 01:04:14.288422 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.288382    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75fdf94bc8-dlv5q"]
Jul 14 01:04:14.290153 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.290137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.292583 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.292563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 01:04:14.292716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.292598    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 01:04:14.292716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.292661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5xx4b\""
Jul 14 01:04:14.292716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.292700    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 01:04:14.297938 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.297910    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 01:04:14.301950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.301919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75fdf94bc8-dlv5q"]
Jul 14 01:04:14.425224 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-registry-tls\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-image-registry-private-configuration\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-registry-certificates\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1257988-23f1-46c0-9525-f8293789c2e7-ca-trust-extracted\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-trusted-ca\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425531 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-bound-sa-token\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425531 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2ld\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-kube-api-access-sf2ld\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.425531 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.425453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-installation-pull-secrets\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526635 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2ld\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-kube-api-access-sf2ld\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-installation-pull-secrets\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-registry-tls\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-image-registry-private-configuration\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-registry-certificates\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.526794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1257988-23f1-46c0-9525-f8293789c2e7-ca-trust-extracted\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.527060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-trusted-ca\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.527060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.526853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-bound-sa-token\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.527359 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.527326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1257988-23f1-46c0-9525-f8293789c2e7-ca-trust-extracted\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.527665 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.527641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-registry-certificates\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.527817 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.527798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1257988-23f1-46c0-9525-f8293789c2e7-trusted-ca\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.529437 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.529410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-registry-tls\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.529750 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.529731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-installation-pull-secrets\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.529896 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.529875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1257988-23f1-46c0-9525-f8293789c2e7-image-registry-private-configuration\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.535357 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.535261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-bound-sa-token\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.535357 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.535319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2ld\" (UniqueName: \"kubernetes.io/projected/c1257988-23f1-46c0-9525-f8293789c2e7-kube-api-access-sf2ld\") pod \"image-registry-75fdf94bc8-dlv5q\" (UID: \"c1257988-23f1-46c0-9525-f8293789c2e7\") " pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.600428 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.600397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.752613 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.752582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75fdf94bc8-dlv5q"]
Jul 14 01:04:14.755975 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:14.755943    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1257988_23f1_46c0_9525_f8293789c2e7.slice/crio-35696cbf719c81a0edf33879a149c8e46d7edd3e5a7bf6027eceb82213e93f46 WatchSource:0}: Error finding container 35696cbf719c81a0edf33879a149c8e46d7edd3e5a7bf6027eceb82213e93f46: Status 404 returned error can't find the container with id 35696cbf719c81a0edf33879a149c8e46d7edd3e5a7bf6027eceb82213e93f46
Jul 14 01:04:14.922564 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.922520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nksx" event={"ID":"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3","Type":"ContainerStarted","Data":"bf0586f6a43bcfa3091cc5a029fd8a5f2c4a39744a2df674a16e92efcf9417bd"}
Jul 14 01:04:14.924246 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.924209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q" event={"ID":"c1257988-23f1-46c0-9525-f8293789c2e7","Type":"ContainerStarted","Data":"181f6db465a77a412a889b8de28d14d29d59d28c13a0a98cfa8c49c3dd1ed5fd"}
Jul 14 01:04:14.924381 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.924265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q" event={"ID":"c1257988-23f1-46c0-9525-f8293789c2e7","Type":"ContainerStarted","Data":"35696cbf719c81a0edf33879a149c8e46d7edd3e5a7bf6027eceb82213e93f46"}
Jul 14 01:04:14.924381 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.924310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:14.943258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:14.943207    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q" podStartSLOduration=0.943188813 podStartE2EDuration="943.188813ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:14.941393272 +0000 UTC m=+248.342704788" watchObservedRunningTime="2026-07-14 01:04:14.943188813 +0000 UTC m=+248.344500303"
Jul 14 01:04:16.935928 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:16.935847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nksx" event={"ID":"aae0ac19-e3d4-41b3-b3d8-271fe15ffde3","Type":"ContainerStarted","Data":"f13b2dfe761e07c3fadb71abf21e421ee63e0f395c9ab29523951497cef114e0"}
Jul 14 01:04:16.954553 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:16.954307    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9nksx" podStartSLOduration=17.380887308 podStartE2EDuration="24.954286258s" totalImagesPullingTime="7.57339895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:03:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:16.953617185 +0000 UTC m=+250.354928676" watchObservedRunningTime="2026-07-14 01:04:16.954286258 +0000 UTC m=+250.355597751"
Jul 14 01:04:17.917661 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:17.917622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:04:17.917822 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:17.917707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:04:17.918000 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:17.917987    2565 scope.go:117] "RemoveContainer" containerID="91247a0f4d770d2c86110fb836a1009663941cfc5e62617299c055dd429312cd"
Jul 14 01:04:17.918181 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:17.918156    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-x822p_openshift-console-operator(b7c15590-6880-4f4f-92c9-39e078e1c125)\"" pod="openshift-console-operator/console-operator-7866497494-x822p" podUID="b7c15590-6880-4f4f-92c9-39e078e1c125"
Jul 14 01:04:18.959515 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:18.959476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:04:18.961882 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:18.961852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d324260d-db38-4bfb-8e21-bf894cd91a92-metrics-certs\") pod \"network-metrics-daemon-2f7j6\" (UID: \"d324260d-db38-4bfb-8e21-bf894cd91a92\") " pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:04:19.068980 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:19.068945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6f2s8\""
Jul 14 01:04:19.077350 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:19.077329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2f7j6"
Jul 14 01:04:19.200611 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:19.200582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2f7j6"]
Jul 14 01:04:19.203749 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:19.203718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd324260d_db38_4bfb_8e21_bf894cd91a92.slice/crio-4791cda71bc02c3d6c92fd117ef55f854556101f5d006388c97f15d08faefe85 WatchSource:0}: Error finding container 4791cda71bc02c3d6c92fd117ef55f854556101f5d006388c97f15d08faefe85: Status 404 returned error can't find the container with id 4791cda71bc02c3d6c92fd117ef55f854556101f5d006388c97f15d08faefe85
Jul 14 01:04:19.948136 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:19.948083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2f7j6" event={"ID":"d324260d-db38-4bfb-8e21-bf894cd91a92","Type":"ContainerStarted","Data":"4791cda71bc02c3d6c92fd117ef55f854556101f5d006388c97f15d08faefe85"}
Jul 14 01:04:20.953041 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:20.953004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2f7j6" event={"ID":"d324260d-db38-4bfb-8e21-bf894cd91a92","Type":"ContainerStarted","Data":"7e2d36bdcd7c01376e84c26cfea9c452fdfa301b9015166302668a6953e8259e"}
Jul 14 01:04:20.953447 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:20.953055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2f7j6" event={"ID":"d324260d-db38-4bfb-8e21-bf894cd91a92","Type":"ContainerStarted","Data":"4b4b170dd54a301c6419c23a02621049768b134dfaa21c5cd866e9a01c79b0d8"}
Jul 14 01:04:20.967316 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:20.967266    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2f7j6" podStartSLOduration=252.878348638 podStartE2EDuration="4m13.967250472s" totalImagesPullingTime="1.088901834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:20.9663313 +0000 UTC m=+254.367642791" watchObservedRunningTime="2026-07-14 01:04:20.967250472 +0000 UTC m=+254.368561965"
Jul 14 01:04:31.837999 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.837960    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q259w"]
Jul 14 01:04:31.841393 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.841370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.843488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.843464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 01:04:31.843591 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.843512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s7dcf\""
Jul 14 01:04:31.843771 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.843754    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 01:04:31.844040 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.844019    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 01:04:31.844235 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.844217    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 01:04:31.844554 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.844535    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 01:04:31.844636 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.844593    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 01:04:31.955777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-tls\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srq85\" (UniqueName: \"kubernetes.io/projected/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-kube-api-access-srq85\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-metrics-client-ca\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-wtmp\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-sys\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.955993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.955973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-textfile\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:31.956230 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:31.956005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-root\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057023 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.056994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-root\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-tls\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srq85\" (UniqueName: \"kubernetes.io/projected/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-kube-api-access-srq85\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-metrics-client-ca\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-wtmp\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-root\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-sys\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-textfile\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-wtmp\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-sys\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057691 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-textfile\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-metrics-client-ca\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.057967 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.057950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-accelerators-collector-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.060310 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.060288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-tls\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.060433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.060417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.064596 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.064571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srq85\" (UniqueName: \"kubernetes.io/projected/b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5-kube-api-access-srq85\") pod \"node-exporter-q259w\" (UID: \"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5\") " pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.151198 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.151074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q259w"
Jul 14 01:04:32.161007 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:32.160971    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d6035a_7638_4a2a_9ff8_a81b06d8e3f5.slice/crio-d93a9eb8e36c032014790a4b310600464708b590dfffe4a8178fc137d95a5356 WatchSource:0}: Error finding container d93a9eb8e36c032014790a4b310600464708b590dfffe4a8178fc137d95a5356: Status 404 returned error can't find the container with id d93a9eb8e36c032014790a4b310600464708b590dfffe4a8178fc137d95a5356
Jul 14 01:04:32.881061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.881019    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:04:32.884672 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.884647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.886883 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.886864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 01:04:32.887050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 01:04:32.887150 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrzzg\""
Jul 14 01:04:32.887360 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887342    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 01:04:32.887435 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 01:04:32.887491 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 01:04:32.887676 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 01:04:32.887730 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 01:04:32.887780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 01:04:32.887861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.887847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 01:04:32.897468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.897443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:04:32.964308 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964308 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964830 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkp59\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964830 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964830 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964830 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.964830 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.964687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:32.993630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:32.993591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q259w" event={"ID":"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5","Type":"ContainerStarted","Data":"d93a9eb8e36c032014790a4b310600464708b590dfffe4a8178fc137d95a5356"}
Jul 14 01:04:33.065487 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065487 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkp59\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.065723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.066080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.066080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.066080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.066080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.065804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.066733 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.066673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.067300 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.067258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.067886 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.067857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.069550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.069550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.069550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.069550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.070260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.070260 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.069965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.070656 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.070635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.070741 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.070687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.071010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.070988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.074035 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.074017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkp59\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59\") pod \"alertmanager-main-0\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.165818 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.165729    2565 scope.go:117] "RemoveContainer" containerID="91247a0f4d770d2c86110fb836a1009663941cfc5e62617299c055dd429312cd"
Jul 14 01:04:33.194715 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.194684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:04:33.358738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.358709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:04:33.361091 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:33.361061    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90289e72_0e24_428f_a03d_fc96db52ec80.slice/crio-3c52dd5ff52a075cb66c11897abd18ca72613f862b53311f12fb3e1e2584eb64 WatchSource:0}: Error finding container 3c52dd5ff52a075cb66c11897abd18ca72613f862b53311f12fb3e1e2584eb64: Status 404 returned error can't find the container with id 3c52dd5ff52a075cb66c11897abd18ca72613f862b53311f12fb3e1e2584eb64
Jul 14 01:04:33.872335 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.872301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-jbn2k"]
Jul 14 01:04:33.875404 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.875389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:33.877917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.877891    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8kc9j\""
Jul 14 01:04:33.878050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.877900    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 01:04:33.878050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.877945    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 01:04:33.884686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.884662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jbn2k"]
Jul 14 01:04:33.973142 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.973081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27qsk\" (UniqueName: \"kubernetes.io/projected/e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00-kube-api-access-27qsk\") pod \"downloads-68c9cbb497-jbn2k\" (UID: \"e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00\") " pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:33.999550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.999516    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:04:33.999715 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.999648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-x822p" event={"ID":"b7c15590-6880-4f4f-92c9-39e078e1c125","Type":"ContainerStarted","Data":"cefb391c8ef03a1120417d6b6f078989382f368aa15aec0ce0ba06917d306434"}
Jul 14 01:04:34.000000 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:33.999963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:04:34.001636 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.001607    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5" containerID="5360c14a19e4eb065a2ba505aa76393a4b95e89afd58b363afb64752436bb54e" exitCode=0
Jul 14 01:04:34.001755 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.001702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q259w" event={"ID":"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5","Type":"ContainerDied","Data":"5360c14a19e4eb065a2ba505aa76393a4b95e89afd58b363afb64752436bb54e"}
Jul 14 01:04:34.003435 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.003412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"3c52dd5ff52a075cb66c11897abd18ca72613f862b53311f12fb3e1e2584eb64"}
Jul 14 01:04:34.006602 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.006583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-x822p"
Jul 14 01:04:34.015704 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.015659    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-x822p" podStartSLOduration=44.469972249 podStartE2EDuration="47.015640015s" totalImagesPullingTime="2.545667766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:34.015399237 +0000 UTC m=+267.416710730" watchObservedRunningTime="2026-07-14 01:04:34.015640015 +0000 UTC m=+267.416951506"
Jul 14 01:04:34.075416 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.074859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27qsk\" (UniqueName: \"kubernetes.io/projected/e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00-kube-api-access-27qsk\") pod \"downloads-68c9cbb497-jbn2k\" (UID: \"e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00\") " pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:34.083647 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.083622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27qsk\" (UniqueName: \"kubernetes.io/projected/e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00-kube-api-access-27qsk\") pod \"downloads-68c9cbb497-jbn2k\" (UID: \"e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00\") " pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:34.184881 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.184845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:34.309290 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.309247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jbn2k"]
Jul 14 01:04:34.313725 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:34.313700    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68ce7d2_1c3c_4f5a_b377_3b3adef7ba00.slice/crio-135e8e2805f2f86d03952359239f2a175140a65c9eb0bbfc9bf17c327c277f1a WatchSource:0}: Error finding container 135e8e2805f2f86d03952359239f2a175140a65c9eb0bbfc9bf17c327c277f1a: Status 404 returned error can't find the container with id 135e8e2805f2f86d03952359239f2a175140a65c9eb0bbfc9bf17c327c277f1a
Jul 14 01:04:34.606952 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.606911    2565 patch_prober.go:28] interesting pod/image-registry-75fdf94bc8-dlv5q container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 14 01:04:34.607172 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.606984    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q" podUID="c1257988-23f1-46c0-9525-f8293789c2e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 01:04:34.802545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.802520    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66658f696-dd5lv"]
Jul 14 01:04:34.805857 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.805839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.808363 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 01:04:34.808454 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808420    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 01:04:34.808454 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 01:04:34.808702 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7p674vmv2mkht\""
Jul 14 01:04:34.808774 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 01:04:34.808774 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.808739    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 01:04:34.809319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.809303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z69sd\""
Jul 14 01:04:34.816727 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.816706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66658f696-dd5lv"]
Jul 14 01:04:34.881155 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee551b19-4238-4401-9789-1f03c1404274-metrics-client-ca\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbq9l\" (UniqueName: \"kubernetes.io/projected/ee551b19-4238-4401-9789-1f03c1404274-kube-api-access-bbq9l\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-grpc-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.881457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.881401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982255 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee551b19-4238-4401-9789-1f03c1404274-metrics-client-ca\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbq9l\" (UniqueName: \"kubernetes.io/projected/ee551b19-4238-4401-9789-1f03c1404274-kube-api-access-bbq9l\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.982637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.982533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-grpc-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.983339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.983228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee551b19-4238-4401-9789-1f03c1404274-metrics-client-ca\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.985340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.985314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.985670 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.985537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.985670 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.985609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-grpc-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.985836 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.985818    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.985897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.985833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-tls\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.986114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.986094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ee551b19-4238-4401-9789-1f03c1404274-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:34.990233 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:34.990214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbq9l\" (UniqueName: \"kubernetes.io/projected/ee551b19-4238-4401-9789-1f03c1404274-kube-api-access-bbq9l\") pod \"thanos-querier-66658f696-dd5lv\" (UID: \"ee551b19-4238-4401-9789-1f03c1404274\") " pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:35.010137 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.010087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q259w" event={"ID":"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5","Type":"ContainerStarted","Data":"fa7797d6ac04736da03edce5bebf9dc69f1ba23a21a6f6927b6379c2407c19b5"}
Jul 14 01:04:35.010259 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.010171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q259w" event={"ID":"b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5","Type":"ContainerStarted","Data":"dc53b674d6f44455cbd16cf303bb93c99c3fbb3de4b980861df09ad69f79856d"}
Jul 14 01:04:35.011569 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.011548    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461" exitCode=0
Jul 14 01:04:35.011668 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.011626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"}
Jul 14 01:04:35.012780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.012756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jbn2k" event={"ID":"e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00","Type":"ContainerStarted","Data":"135e8e2805f2f86d03952359239f2a175140a65c9eb0bbfc9bf17c327c277f1a"}
Jul 14 01:04:35.026793 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.026753    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q259w" podStartSLOduration=2.847732359 podStartE2EDuration="4.026741598s" totalImagesPullingTime="1.103305809s" totalInitContainerRuntime="75.70343ms" isStatefulPod=true podCreationTimestamp="2026-07-14 01:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:35.025886478 +0000 UTC m=+268.427197982" watchObservedRunningTime="2026-07-14 01:04:35.026741598 +0000 UTC m=+268.428053089"
Jul 14 01:04:35.160828 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.160748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:35.311935 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.311901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66658f696-dd5lv"]
Jul 14 01:04:35.314516 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:35.314489    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee551b19_4238_4401_9789_1f03c1404274.slice/crio-865d32183f2df8b91aa20df96cb969a804337bcff7e206607ceb5aeb41f8a3ef WatchSource:0}: Error finding container 865d32183f2df8b91aa20df96cb969a804337bcff7e206607ceb5aeb41f8a3ef: Status 404 returned error can't find the container with id 865d32183f2df8b91aa20df96cb969a804337bcff7e206607ceb5aeb41f8a3ef
Jul 14 01:04:35.935484 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:35.935460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75fdf94bc8-dlv5q"
Jul 14 01:04:36.020145 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:36.020064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"865d32183f2df8b91aa20df96cb969a804337bcff7e206607ceb5aeb41f8a3ef"}
Jul 14 01:04:37.027242 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:37.027216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"}
Jul 14 01:04:37.027571 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:37.027295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"}
Jul 14 01:04:38.035785 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:38.035757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"}
Jul 14 01:04:38.036165 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:38.035839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"}
Jul 14 01:04:38.036165 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:38.035869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"}
Jul 14 01:04:39.045570 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.045534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerStarted","Data":"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"}
Jul 14 01:04:39.050490 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.050457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"42a2a368b39a442075572ada14d06005993f7d15b8b8103f455a731970e5fdac"}
Jul 14 01:04:39.050601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.050538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"c3ef888356ec16bd41c3e9f9ecf6f74dd137c61dbb5e9077ce4ff2c677d4432b"}
Jul 14 01:04:39.050601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.050569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"5fed67ee662d325804a0675ee4144d6d365509b9b1ff5d450a57b74792728529"}
Jul 14 01:04:39.050681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.050601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"27af4093e74f76a2124e4a596f1d76a0a4538ef9dca1c8a3a6bc722bf6b477b8"}
Jul 14 01:04:39.050681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.050628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"7d00620fdd7081dd1e13982875035853f401bd1048c58f4fde62ef8e8537b700"}
Jul 14 01:04:39.074145 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:39.074010    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.178074434 podStartE2EDuration="7.073993213s" totalImagesPullingTime="4.879529971s" totalInitContainerRuntime="16.388808ms" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:39.071964314 +0000 UTC m=+272.473275806" watchObservedRunningTime="2026-07-14 01:04:39.073993213 +0000 UTC m=+272.475304704"
Jul 14 01:04:40.057592 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:40.057548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" event={"ID":"ee551b19-4238-4401-9789-1f03c1404274","Type":"ContainerStarted","Data":"0359ca415821f788df7f6c1c87fabe954346165494646cf1b3b10f40c95f8b5e"}
Jul 14 01:04:40.080667 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:40.080615    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv" podStartSLOduration=2.709782797 podStartE2EDuration="6.080598507s" totalImagesPullingTime="3.37081571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:40.078329661 +0000 UTC m=+273.479641153" watchObservedRunningTime="2026-07-14 01:04:40.080598507 +0000 UTC m=+273.481910001"
Jul 14 01:04:41.062169 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:41.062132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:43.186315 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.186280    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:04:43.189819 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.189792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.192431 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.192405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 01:04:43.192553 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.192449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 01:04:43.192553 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.192472    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 01:04:43.193472 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.193449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 01:04:43.193581 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.193457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 01:04:43.193769 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.193739    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zqnn7\""
Jul 14 01:04:43.197053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.197017    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:04:43.361165 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.361336 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwhsv\" (UniqueName: \"kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.361336 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.361336 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.361336 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.361336 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.361334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462502 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462502 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwhsv\" (UniqueName: \"kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.462906 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.462882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.463366 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.463320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.463366 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.463324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.463533 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.463367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.465954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.465931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.466068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.465970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.471350 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.471315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwhsv\" (UniqueName: \"kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv\") pod \"console-7b84997dbd-szwh9\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") " pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.501299 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.501261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:04:43.648325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:43.648288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:04:43.653188 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:43.653111    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741327e9_5b8d_4ee0_b606_562b0f65470b.slice/crio-ff0adb1b25832a683dcd08352c45a6f48ad29a0a20d50a063ae239a1d144be72 WatchSource:0}: Error finding container ff0adb1b25832a683dcd08352c45a6f48ad29a0a20d50a063ae239a1d144be72: Status 404 returned error can't find the container with id ff0adb1b25832a683dcd08352c45a6f48ad29a0a20d50a063ae239a1d144be72
Jul 14 01:04:44.079891 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:44.079854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b84997dbd-szwh9" event={"ID":"741327e9-5b8d-4ee0-b606-562b0f65470b","Type":"ContainerStarted","Data":"ff0adb1b25832a683dcd08352c45a6f48ad29a0a20d50a063ae239a1d144be72"}
Jul 14 01:04:47.078341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:47.078309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66658f696-dd5lv"
Jul 14 01:04:47.652405 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:04:47.652358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xv6xw" podUID="b883267b-d699-4506-9721-2df37880c63c"
Jul 14 01:04:48.097178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:48.097145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:04:51.434926 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:51.434884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:04:51.437621 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:51.437596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b883267b-d699-4506-9721-2df37880c63c-metrics-tls\") pod \"dns-default-xv6xw\" (UID: \"b883267b-d699-4506-9721-2df37880c63c\") " pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:04:51.701077 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:51.701002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jf2dk\""
Jul 14 01:04:51.709032 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:51.708998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:04:54.680831 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:54.680756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xv6xw"]
Jul 14 01:04:54.684793 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:04:54.684754    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb883267b_d699_4506_9721_2df37880c63c.slice/crio-e93ece1550cd53c26c9813f710b8673ebae359d31532bd8c54c9ca2a9ad7833b WatchSource:0}: Error finding container e93ece1550cd53c26c9813f710b8673ebae359d31532bd8c54c9ca2a9ad7833b: Status 404 returned error can't find the container with id e93ece1550cd53c26c9813f710b8673ebae359d31532bd8c54c9ca2a9ad7833b
Jul 14 01:04:55.127480 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.126937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b84997dbd-szwh9" event={"ID":"741327e9-5b8d-4ee0-b606-562b0f65470b","Type":"ContainerStarted","Data":"ac487d224f0848956c8db529afd8368ff4166c2bd6e526f846e51a28363f245e"}
Jul 14 01:04:55.128454 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.128415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6xw" event={"ID":"b883267b-d699-4506-9721-2df37880c63c","Type":"ContainerStarted","Data":"e93ece1550cd53c26c9813f710b8673ebae359d31532bd8c54c9ca2a9ad7833b"}
Jul 14 01:04:55.130333 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.130308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jbn2k" event={"ID":"e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00","Type":"ContainerStarted","Data":"4e6cbd82b8d59ea5675af8de7f7e865215f412cb91a737a88ddc6850f8037517"}
Jul 14 01:04:55.130500 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.130487    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:55.144977 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.144922    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b84997dbd-szwh9" podStartSLOduration=1.253126256 podStartE2EDuration="12.144904315s" totalImagesPullingTime="10.891778059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:55.14328995 +0000 UTC m=+288.544601443" watchObservedRunningTime="2026-07-14 01:04:55.144904315 +0000 UTC m=+288.546215806"
Jul 14 01:04:55.147487 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.147463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-jbn2k"
Jul 14 01:04:55.160368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:55.160308    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-jbn2k" podStartSLOduration=1.859949901 podStartE2EDuration="22.160287287s" totalImagesPullingTime="20.300337386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:55.158385081 +0000 UTC m=+288.559696599" watchObservedRunningTime="2026-07-14 01:04:55.160287287 +0000 UTC m=+288.561598780"
Jul 14 01:04:58.148492 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:58.148454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6xw" event={"ID":"b883267b-d699-4506-9721-2df37880c63c","Type":"ContainerStarted","Data":"7bb98b4a37928a6dd06e4ce1b8fc0358dae193d03e9bde03143b5671aa0a1daa"}
Jul 14 01:04:58.148927 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:58.148524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6xw" event={"ID":"b883267b-d699-4506-9721-2df37880c63c","Type":"ContainerStarted","Data":"ddee884d778ae11c226df9d96ce164f4e4977cb6712fa1edfbae2cf68b0e9edc"}
Jul 14 01:04:58.148927 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:58.148558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:04:58.167934 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:04:58.167872    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xv6xw" podStartSLOduration=254.160265161 podStartE2EDuration="4m17.167852471s" totalImagesPullingTime="3.00758731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:58.166205013 +0000 UTC m=+291.567516693" watchObservedRunningTime="2026-07-14 01:04:58.167852471 +0000 UTC m=+291.569163965"
Jul 14 01:05:02.124898 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:02.124863    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:05:02.941848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:02.941793    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" podUID="0ab4126f-73d5-4bb1-983a-ad45d60dd050" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 01:05:03.502247 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:03.502208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:05:07.020197 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:07.020172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:05:07.020630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:07.020559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:05:07.027836 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:07.027812    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:05:07.027981 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:07.027966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:05:07.031326 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:07.031306    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 01:05:08.154859 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:08.154830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xv6xw"
Jul 14 01:05:12.941834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:12.941791    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" podUID="0ab4126f-73d5-4bb1-983a-ad45d60dd050" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 01:05:22.941028 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:22.940991    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" podUID="0ab4126f-73d5-4bb1-983a-ad45d60dd050" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 01:05:22.941429 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:22.941069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f"
Jul 14 01:05:22.941668 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:22.941632    2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0d509aaa9306e61bba1bd6ac9e2b02090daad105edfe89435d79926fa645c2fe"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 14 01:05:22.941707 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:22.941693    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" podUID="0ab4126f-73d5-4bb1-983a-ad45d60dd050" containerName="service-proxy" containerID="cri-o://0d509aaa9306e61bba1bd6ac9e2b02090daad105edfe89435d79926fa645c2fe" gracePeriod=30
Jul 14 01:05:23.250116 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:23.250033    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ab4126f-73d5-4bb1-983a-ad45d60dd050" containerID="0d509aaa9306e61bba1bd6ac9e2b02090daad105edfe89435d79926fa645c2fe" exitCode=2
Jul 14 01:05:23.250116 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:23.250097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerDied","Data":"0d509aaa9306e61bba1bd6ac9e2b02090daad105edfe89435d79926fa645c2fe"}
Jul 14 01:05:23.250319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:23.250165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664cdd94d5-7874f" event={"ID":"0ab4126f-73d5-4bb1-983a-ad45d60dd050","Type":"ContainerStarted","Data":"14d37791d9e4ca4c161c9a44097bdad1436747c35833872c3b59c7fa791e7a3d"}
Jul 14 01:05:27.151082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.151037    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b84997dbd-szwh9" podUID="741327e9-5b8d-4ee0-b606-562b0f65470b" containerName="console" containerID="cri-o://ac487d224f0848956c8db529afd8368ff4166c2bd6e526f846e51a28363f245e" gracePeriod=15
Jul 14 01:05:27.267922 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.267887    2565 generic.go:356] "Generic (PLEG): container finished" podID="741327e9-5b8d-4ee0-b606-562b0f65470b" containerID="ac487d224f0848956c8db529afd8368ff4166c2bd6e526f846e51a28363f245e" exitCode=0
Jul 14 01:05:27.268074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.267962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b84997dbd-szwh9" event={"ID":"741327e9-5b8d-4ee0-b606-562b0f65470b","Type":"ContainerDied","Data":"ac487d224f0848956c8db529afd8368ff4166c2bd6e526f846e51a28363f245e"}
Jul 14 01:05:27.416147 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.416072    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:05:27.550722 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.550722 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.550955 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550748    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.550955 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.550955 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.550955 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.550827    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwhsv\" (UniqueName: \"kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv\") pod \"741327e9-5b8d-4ee0-b606-562b0f65470b\" (UID: \"741327e9-5b8d-4ee0-b606-562b0f65470b\") "
Jul 14 01:05:27.551231 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.551188    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca" (OuterVolumeSpecName: "service-ca") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:05:27.551346 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.551197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config" (OuterVolumeSpecName: "console-config") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:05:27.551346 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.551245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:05:27.553165 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.553142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:27.553255 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.553220    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv" (OuterVolumeSpecName: "kube-api-access-cwhsv") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "kube-api-access-cwhsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:05:27.553255 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.553230    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "741327e9-5b8d-4ee0-b606-562b0f65470b" (UID: "741327e9-5b8d-4ee0-b606-562b0f65470b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:27.651858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651833    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-oauth-config\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:27.651858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651853    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-console-config\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:27.651858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651862    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-service-ca\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:27.652056 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651870    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/741327e9-5b8d-4ee0-b606-562b0f65470b-console-serving-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:27.652056 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651877    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/741327e9-5b8d-4ee0-b606-562b0f65470b-oauth-serving-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:27.652056 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:27.651885    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwhsv\" (UniqueName: \"kubernetes.io/projected/741327e9-5b8d-4ee0-b606-562b0f65470b-kube-api-access-cwhsv\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:28.272546 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:28.272521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b84997dbd-szwh9"
Jul 14 01:05:28.272546 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:28.272542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b84997dbd-szwh9" event={"ID":"741327e9-5b8d-4ee0-b606-562b0f65470b","Type":"ContainerDied","Data":"ff0adb1b25832a683dcd08352c45a6f48ad29a0a20d50a063ae239a1d144be72"}
Jul 14 01:05:28.273008 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:28.272593    2565 scope.go:117] "RemoveContainer" containerID="ac487d224f0848956c8db529afd8368ff4166c2bd6e526f846e51a28363f245e"
Jul 14 01:05:28.291627 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:28.291604    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:05:28.293801 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:28.293780    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b84997dbd-szwh9"]
Jul 14 01:05:29.169943 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:29.169913    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741327e9-5b8d-4ee0-b606-562b0f65470b" path="/var/lib/kubelet/pods/741327e9-5b8d-4ee0-b606-562b0f65470b/volumes"
Jul 14 01:05:52.172250 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.172215    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:52.359985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.359929    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="alertmanager" containerID="cri-o://dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c" gracePeriod=120
Jul 14 01:05:52.360275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.359987    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-metric" containerID="cri-o://01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d" gracePeriod=120
Jul 14 01:05:52.360275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.360012    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-web" containerID="cri-o://552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1" gracePeriod=120
Jul 14 01:05:52.360275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.360032    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy" containerID="cri-o://b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f" gracePeriod=120
Jul 14 01:05:52.360275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.360058    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="config-reloader" containerID="cri-o://7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e" gracePeriod=120
Jul 14 01:05:52.360275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:52.360082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="prom-label-proxy" containerID="cri-o://0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b" gracePeriod=120
Jul 14 01:05:53.367329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367300    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b" exitCode=0
Jul 14 01:05:53.367329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367324    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f" exitCode=0
Jul 14 01:05:53.367329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367330    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e" exitCode=0
Jul 14 01:05:53.367329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367337    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c" exitCode=0
Jul 14 01:05:53.367795 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"}
Jul 14 01:05:53.367795 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"}
Jul 14 01:05:53.367795 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"}
Jul 14 01:05:53.367795 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.367494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"}
Jul 14 01:05:53.600362 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.600341    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:53.639663 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639663 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639663 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639700    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkp59\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639853    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.639919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639902    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy\") pod \"90289e72-0e24-428f-a03d-fc96db52ec80\" (UID: \"90289e72-0e24-428f-a03d-fc96db52ec80\") "
Jul 14 01:05:53.640461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:05:53.640461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.639994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:05:53.640461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.640181    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-main-db\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.640461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.640207    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.641218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.641089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:05:53.643446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.643422    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.643769 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.643724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.643769 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.643755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.644052 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.644023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:05:53.644381 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.644345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.644486 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.644427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out" (OuterVolumeSpecName: "config-out") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:05:53.644576 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.644550    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59" (OuterVolumeSpecName: "kube-api-access-fkp59") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "kube-api-access-fkp59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:05:53.645389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.645370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume" (OuterVolumeSpecName: "config-volume") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.650194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.650160    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.655789 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.655767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config" (OuterVolumeSpecName: "web-config") pod "90289e72-0e24-428f-a03d-fc96db52ec80" (UID: "90289e72-0e24-428f-a03d-fc96db52ec80"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:05:53.740994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.740965    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.740994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.740987    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-tls-assets\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.740994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.740998    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741007    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-cluster-tls-config\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741017    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-web-config\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741025    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741034    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90289e72-0e24-428f-a03d-fc96db52ec80-config-out\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741043    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-secret-alertmanager-main-tls\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741052    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90289e72-0e24-428f-a03d-fc96db52ec80-metrics-client-ca\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741059    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90289e72-0e24-428f-a03d-fc96db52ec80-config-volume\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:53.741238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:53.741067    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkp59\" (UniqueName: \"kubernetes.io/projected/90289e72-0e24-428f-a03d-fc96db52ec80-kube-api-access-fkp59\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:05:54.374664 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374629    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d" exitCode=0
Jul 14 01:05:54.374664 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374654    2565 generic.go:356] "Generic (PLEG): container finished" podID="90289e72-0e24-428f-a03d-fc96db52ec80" containerID="552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1" exitCode=0
Jul 14 01:05:54.375113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"}
Jul 14 01:05:54.375113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374704    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.375113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"}
Jul 14 01:05:54.375113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90289e72-0e24-428f-a03d-fc96db52ec80","Type":"ContainerDied","Data":"3c52dd5ff52a075cb66c11897abd18ca72613f862b53311f12fb3e1e2584eb64"}
Jul 14 01:05:54.375113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.374806    2565 scope.go:117] "RemoveContainer" containerID="0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"
Jul 14 01:05:54.386175 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.386157    2565 scope.go:117] "RemoveContainer" containerID="01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"
Jul 14 01:05:54.393020 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.393004    2565 scope.go:117] "RemoveContainer" containerID="b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"
Jul 14 01:05:54.398470 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.398447    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:54.400034 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.400012    2565 scope.go:117] "RemoveContainer" containerID="552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"
Jul 14 01:05:54.402884 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.402860    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:54.406697 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.406679    2565 scope.go:117] "RemoveContainer" containerID="7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"
Jul 14 01:05:54.413369 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.413352    2565 scope.go:117] "RemoveContainer" containerID="dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"
Jul 14 01:05:54.420188 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.420168    2565 scope.go:117] "RemoveContainer" containerID="fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"
Jul 14 01:05:54.426839 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.426820    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:54.427060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427048    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="alertmanager"
Jul 14 01:05:54.427060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427061    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="alertmanager"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427068    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="config-reloader"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427073    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="config-reloader"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427089    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-metric"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427095    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-metric"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427103    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427108    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427116    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="init-config-reloader"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427145    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="init-config-reloader"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427151    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-web"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427156    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-web"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="prom-label-proxy"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427173    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="prom-label-proxy"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427181    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741327e9-5b8d-4ee0-b606-562b0f65470b" containerName="console"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427186    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="741327e9-5b8d-4ee0-b606-562b0f65470b" containerName="console"
Jul 14 01:05:54.427216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-metric"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427231    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="prom-label-proxy"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427237    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="741327e9-5b8d-4ee0-b606-562b0f65470b" containerName="console"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427242    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="config-reloader"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427247    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy-web"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427253    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="alertmanager"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" containerName="kube-rbac-proxy"
Jul 14 01:05:54.427813 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.427752    2565 scope.go:117] "RemoveContainer" containerID="0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"
Jul 14 01:05:54.428082 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.428001    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b\": container with ID starting with 0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b not found: ID does not exist" containerID="0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"
Jul 14 01:05:54.428082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428025    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"} err="failed to get container status \"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b\": rpc error: code = NotFound desc = could not find container \"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b\": container with ID starting with 0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b not found: ID does not exist"
Jul 14 01:05:54.428082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428041    2565 scope.go:117] "RemoveContainer" containerID="01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"
Jul 14 01:05:54.428308 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.428292    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d\": container with ID starting with 01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d not found: ID does not exist" containerID="01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"
Jul 14 01:05:54.428382 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428313    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"} err="failed to get container status \"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d\": rpc error: code = NotFound desc = could not find container \"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d\": container with ID starting with 01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d not found: ID does not exist"
Jul 14 01:05:54.428382 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428331    2565 scope.go:117] "RemoveContainer" containerID="b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"
Jul 14 01:05:54.428547 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.428530    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f\": container with ID starting with b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f not found: ID does not exist" containerID="b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"
Jul 14 01:05:54.428585 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428553    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"} err="failed to get container status \"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f\": rpc error: code = NotFound desc = could not find container \"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f\": container with ID starting with b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f not found: ID does not exist"
Jul 14 01:05:54.428585 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.428576    2565 scope.go:117] "RemoveContainer" containerID="552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"
Jul 14 01:05:54.430639 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.430614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.433970 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.433865    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1\": container with ID starting with 552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1 not found: ID does not exist" containerID="552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"
Jul 14 01:05:54.434085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.433974    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"} err="failed to get container status \"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1\": rpc error: code = NotFound desc = could not find container \"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1\": container with ID starting with 552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1 not found: ID does not exist"
Jul 14 01:05:54.434085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434031    2565 scope.go:117] "RemoveContainer" containerID="7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"
Jul 14 01:05:54.434085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 01:05:54.434085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 01:05:54.434328 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 01:05:54.434328 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 01:05:54.434328 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 01:05:54.434452 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 01:05:54.434907 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 01:05:54.434907 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.434856    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e\": container with ID starting with 7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e not found: ID does not exist" containerID="7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"
Jul 14 01:05:54.434907 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434900    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"} err="failed to get container status \"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e\": rpc error: code = NotFound desc = could not find container \"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e\": container with ID starting with 7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e not found: ID does not exist"
Jul 14 01:05:54.435206 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.434918    2565 scope.go:117] "RemoveContainer" containerID="dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"
Jul 14 01:05:54.435271 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.435202    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c\": container with ID starting with dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c not found: ID does not exist" containerID="dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"
Jul 14 01:05:54.435271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435229    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"} err="failed to get container status \"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c\": rpc error: code = NotFound desc = could not find container \"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c\": container with ID starting with dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c not found: ID does not exist"
Jul 14 01:05:54.435271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435250    2565 scope.go:117] "RemoveContainer" containerID="fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"
Jul 14 01:05:54.435440 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 01:05:54.435440 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vrzzg\""
Jul 14 01:05:54.435831 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:05:54.435811    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461\": container with ID starting with fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461 not found: ID does not exist" containerID="fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"
Jul 14 01:05:54.435910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435834    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"} err="failed to get container status \"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461\": rpc error: code = NotFound desc = could not find container \"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461\": container with ID starting with fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461 not found: ID does not exist"
Jul 14 01:05:54.435910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.435848    2565 scope.go:117] "RemoveContainer" containerID="0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"
Jul 14 01:05:54.436161 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436136    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b"} err="failed to get container status \"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b\": rpc error: code = NotFound desc = could not find container \"0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b\": container with ID starting with 0aa66306ea702c4c2659e434e40dc10e6b282bbc33118beb0c1e9d513f47b62b not found: ID does not exist"
Jul 14 01:05:54.436253 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436163    2565 scope.go:117] "RemoveContainer" containerID="01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"
Jul 14 01:05:54.436471 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436446    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d"} err="failed to get container status \"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d\": rpc error: code = NotFound desc = could not find container \"01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d\": container with ID starting with 01c1d687e53a3f792f69dc4ccf2dbf95a5cd0e94e340f4a7a7c96ea281d3c13d not found: ID does not exist"
Jul 14 01:05:54.436562 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436473    2565 scope.go:117] "RemoveContainer" containerID="b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"
Jul 14 01:05:54.436832 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436811    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f"} err="failed to get container status \"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f\": rpc error: code = NotFound desc = could not find container \"b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f\": container with ID starting with b66f46de9a3036b0634b175f2e833c93fe3efbb10b22269182f00715cc425a0f not found: ID does not exist"
Jul 14 01:05:54.436921 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.436832    2565 scope.go:117] "RemoveContainer" containerID="552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"
Jul 14 01:05:54.437110 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437090    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1"} err="failed to get container status \"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1\": rpc error: code = NotFound desc = could not find container \"552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1\": container with ID starting with 552a5128f8b8de590c3c03354c8e9e50d633626ef456737a97752efdcc3a67c1 not found: ID does not exist"
Jul 14 01:05:54.437110 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437110    2565 scope.go:117] "RemoveContainer" containerID="7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"
Jul 14 01:05:54.437401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437378    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e"} err="failed to get container status \"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e\": rpc error: code = NotFound desc = could not find container \"7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e\": container with ID starting with 7adf5e928445e035a5e786190612d0fef12a7e5829172888eec669e9a16e162e not found: ID does not exist"
Jul 14 01:05:54.437641 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437409    2565 scope.go:117] "RemoveContainer" containerID="dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"
Jul 14 01:05:54.437725 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437682    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c"} err="failed to get container status \"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c\": rpc error: code = NotFound desc = could not find container \"dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c\": container with ID starting with dc0b5f39d8571a89fba09400b3f43c66457155bca7394958dd1bf0ade936813c not found: ID does not exist"
Jul 14 01:05:54.437778 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.437721    2565 scope.go:117] "RemoveContainer" containerID="fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"
Jul 14 01:05:54.438058 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.438027    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461"} err="failed to get container status \"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461\": rpc error: code = NotFound desc = could not find container \"fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461\": container with ID starting with fbf2ed4571b292c2c0207ea6a94766d448a15015ba56410c5de0e9771644a461 not found: ID does not exist"
Jul 14 01:05:54.439749 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.439730    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 01:05:54.443074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.443055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:54.547237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-out\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtdbz\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-kube-api-access-vtdbz\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547451 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-web-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.547757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.547592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.648953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.648882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-out\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.648953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.648915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.648953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.648934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.648958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.648984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtdbz\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-kube-api-access-vtdbz\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-web-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649547 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649547 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.649547 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.649443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.651357 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.650117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.651357 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.650996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e081723-63a7-4f21-bdf9-2fcae54830a6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.651976 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.651945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-out\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.652163 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.652143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.652332 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.652305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.652419 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.652384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.652577 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.652559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.652656 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.652637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.653100 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.653080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-web-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.653688 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.653674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.654010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.653995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e081723-63a7-4f21-bdf9-2fcae54830a6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.656796 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.656781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtdbz\" (UniqueName: \"kubernetes.io/projected/3e081723-63a7-4f21-bdf9-2fcae54830a6-kube-api-access-vtdbz\") pod \"alertmanager-main-0\" (UID: \"3e081723-63a7-4f21-bdf9-2fcae54830a6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.742617 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.742579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 01:05:54.876962 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:54.876933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 01:05:54.880757 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:05:54.880718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e081723_63a7_4f21_bdf9_2fcae54830a6.slice/crio-51a10bc8502f61381ea8a4fb56654a335864f4e5ce361b62cef0bbc1a9c835de WatchSource:0}: Error finding container 51a10bc8502f61381ea8a4fb56654a335864f4e5ce361b62cef0bbc1a9c835de: Status 404 returned error can't find the container with id 51a10bc8502f61381ea8a4fb56654a335864f4e5ce361b62cef0bbc1a9c835de
Jul 14 01:05:55.169405 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:55.169331    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90289e72-0e24-428f-a03d-fc96db52ec80" path="/var/lib/kubelet/pods/90289e72-0e24-428f-a03d-fc96db52ec80/volumes"
Jul 14 01:05:55.381635 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:55.381602    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e081723-63a7-4f21-bdf9-2fcae54830a6" containerID="5594b81d4266b0950d0d8dc9d5530ab9cfb949e686f5fe507b4dc39978ce0da2" exitCode=0
Jul 14 01:05:55.382046 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:55.381685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerDied","Data":"5594b81d4266b0950d0d8dc9d5530ab9cfb949e686f5fe507b4dc39978ce0da2"}
Jul 14 01:05:55.382046 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:55.381748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"51a10bc8502f61381ea8a4fb56654a335864f4e5ce361b62cef0bbc1a9c835de"}
Jul 14 01:05:56.388391 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"ad7fadcfa275ca958236fc4a54655f39dc393feb6e446800b16be8fc9051069b"}
Jul 14 01:05:56.388765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"2ba39f155b7a496f1c354c27945231c5e18746ec0f647fcfd361447cf1fd7f69"}
Jul 14 01:05:56.388765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"bd89d9b9144f9acedf7ad00678c9ad07ec6224bbb37cd8d510ce698b1c397583"}
Jul 14 01:05:56.388765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"53da040ac61682ae436b5aa71b3f8a9046887168782b4f4e6556b47b984107f2"}
Jul 14 01:05:56.388765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"5db0aaad75d1b83141a434fc3fdff1cc32b902277b695822090a523bba677d11"}
Jul 14 01:05:56.388765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.388518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e081723-63a7-4f21-bdf9-2fcae54830a6","Type":"ContainerStarted","Data":"ca1ba043fe8711cc2b94d9b943cd363529a8ca2390212236553ae2555821d155"}
Jul 14 01:05:56.418089 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:05:56.418044    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.40275298 podStartE2EDuration="2.418029238s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.276258ms" isStatefulPod=false podCreationTimestamp="2026-07-14 01:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:05:56.416512468 +0000 UTC m=+349.817823958" watchObservedRunningTime="2026-07-14 01:05:56.418029238 +0000 UTC m=+349.819340728"
Jul 14 01:07:37.313809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.313775    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pk2bc"]
Jul 14 01:07:37.315720 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.315701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.318055 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.318027    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 01:07:37.318193 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.318075    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 01:07:37.318193 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.318089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f84nj\""
Jul 14 01:07:37.325038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.325012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pk2bc"]
Jul 14 01:07:37.435239 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.435207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24fh\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-kube-api-access-c24fh\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.435389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.435256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-bound-sa-token\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.536167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.536113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-bound-sa-token\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.536337 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.536217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24fh\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-kube-api-access-c24fh\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.544111 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.544078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-bound-sa-token\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.544246 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.544158    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24fh\" (UniqueName: \"kubernetes.io/projected/f4d16b4c-07e2-4398-8364-c763b0bbd883-kube-api-access-c24fh\") pod \"cert-manager-55b4d954d5-pk2bc\" (UID: \"f4d16b4c-07e2-4398-8364-c763b0bbd883\") " pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.624452 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.624367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pk2bc"
Jul 14 01:07:37.746784 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.746756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pk2bc"]
Jul 14 01:07:37.750037 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:07:37.750006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4d16b4c_07e2_4398_8364_c763b0bbd883.slice/crio-08500ff52992d2b391c03b05ed5f7d4f728ffeb3e1c18e459bd4a3b539fbcf3c WatchSource:0}: Error finding container 08500ff52992d2b391c03b05ed5f7d4f728ffeb3e1c18e459bd4a3b539fbcf3c: Status 404 returned error can't find the container with id 08500ff52992d2b391c03b05ed5f7d4f728ffeb3e1c18e459bd4a3b539fbcf3c
Jul 14 01:07:37.752117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:37.752099    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 01:07:38.751918 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:38.751883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pk2bc" event={"ID":"f4d16b4c-07e2-4398-8364-c763b0bbd883","Type":"ContainerStarted","Data":"08500ff52992d2b391c03b05ed5f7d4f728ffeb3e1c18e459bd4a3b539fbcf3c"}
Jul 14 01:07:41.766275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:41.766234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pk2bc" event={"ID":"f4d16b4c-07e2-4398-8364-c763b0bbd883","Type":"ContainerStarted","Data":"5a32c26a92d2eed5460177a3d3121e3700eb34a817f6fee1a9f3f0d88ce138d3"}
Jul 14 01:07:41.781133 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:07:41.781074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pk2bc" podStartSLOduration=1.489946727 podStartE2EDuration="4.781059931s" totalImagesPullingTime="3.291113204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:07:41.780277962 +0000 UTC m=+455.181589466" watchObservedRunningTime="2026-07-14 01:07:41.781059931 +0000 UTC m=+455.182371422"
Jul 14 01:08:08.673452 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.673415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"]
Jul 14 01:08:08.675630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.675615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.678246 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.678223    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 01:08:08.678367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.678306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 01:08:08.678367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.678347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 01:08:08.678488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.678263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 01:08:08.678488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.678260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fbcld\""
Jul 14 01:08:08.694191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.694167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"]
Jul 14 01:08:08.775481 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.775444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.775481 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.775488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-tmp\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.775716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.775504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-manifests\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.775716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.775573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9w8w\" (UniqueName: \"kubernetes.io/projected/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-kube-api-access-v9w8w\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.775716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.775591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.876863 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.876825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.876863 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.876863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-tmp\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.877118 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.876881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-manifests\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.877118 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.876919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9w8w\" (UniqueName: \"kubernetes.io/projected/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-kube-api-access-v9w8w\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.877118 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.876937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.877395 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.877374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-manifests\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.879467 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.879434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-tmp\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.879596 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.879541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.879659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.879612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.899214 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.899181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9w8w\" (UniqueName: \"kubernetes.io/projected/d9b03b74-6bcd-4d52-8515-4d3d56ece46b-kube-api-access-v9w8w\") pod \"opendatahub-operator-controller-manager-bc876bb4c-kf76m\" (UID: \"d9b03b74-6bcd-4d52-8515-4d3d56ece46b\") " pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:08.986521 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:08.986431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:09.123823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:09.123736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"]
Jul 14 01:08:09.126618 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:09.126596    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b03b74_6bcd_4d52_8515_4d3d56ece46b.slice/crio-d2de2ea49d98551890f90dd700e48eb53a7ad55f89f867ae4ac693dadd1f7ac5 WatchSource:0}: Error finding container d2de2ea49d98551890f90dd700e48eb53a7ad55f89f867ae4ac693dadd1f7ac5: Status 404 returned error can't find the container with id d2de2ea49d98551890f90dd700e48eb53a7ad55f89f867ae4ac693dadd1f7ac5
Jul 14 01:08:09.865794 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:09.865759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m" event={"ID":"d9b03b74-6bcd-4d52-8515-4d3d56ece46b","Type":"ContainerStarted","Data":"d2de2ea49d98551890f90dd700e48eb53a7ad55f89f867ae4ac693dadd1f7ac5"}
Jul 14 01:08:13.884549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:13.884511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m" event={"ID":"d9b03b74-6bcd-4d52-8515-4d3d56ece46b","Type":"ContainerStarted","Data":"1c48a3f648efc710dd52569492fa88a5861a0300248737a978b17c2a358b6afc"}
Jul 14 01:08:14.889633 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:14.889597    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9b03b74-6bcd-4d52-8515-4d3d56ece46b" containerID="1c48a3f648efc710dd52569492fa88a5861a0300248737a978b17c2a358b6afc" exitCode=0
Jul 14 01:08:14.890011 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:14.889685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m" event={"ID":"d9b03b74-6bcd-4d52-8515-4d3d56ece46b","Type":"ContainerDied","Data":"1c48a3f648efc710dd52569492fa88a5861a0300248737a978b17c2a358b6afc"}
Jul 14 01:08:15.896403 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:15.896368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m" event={"ID":"d9b03b74-6bcd-4d52-8515-4d3d56ece46b","Type":"ContainerStarted","Data":"477c1a47fc03411ce7ba17efff42139b198b3261f8247f450e838e128acae617"}
Jul 14 01:08:15.896869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:15.896475    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:15.916329 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:15.916281    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m" podStartSLOduration=1.819756585 podStartE2EDuration="7.916265048s" totalImagesPullingTime="5.059314419s" totalInitContainerRuntime="1.037194044s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:15.914979023 +0000 UTC m=+489.316290515" watchObservedRunningTime="2026-07-14 01:08:15.916265048 +0000 UTC m=+489.317576538"
Jul 14 01:08:26.903015 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:26.902979    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc876bb4c-kf76m"
Jul 14 01:08:29.175326 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.175293    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d697d898-p7psj"]
Jul 14 01:08:29.178108 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.178092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.180573 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.180553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-64cwf\""
Jul 14 01:08:29.181600 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.181582    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 01:08:29.181691 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.181632    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 01:08:29.181691 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.181636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 01:08:29.182151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.182138    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 01:08:29.190597 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.190574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d697d898-p7psj"]
Jul 14 01:08:29.251739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.251712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdzl\" (UniqueName: \"kubernetes.io/projected/48c8bb7f-7ad5-4924-a52d-4575132cad43-kube-api-access-hzdzl\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.251739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.251743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c8bb7f-7ad5-4924-a52d-4575132cad43-tls-certs\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.251930 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.251772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c8bb7f-7ad5-4924-a52d-4575132cad43-tmp\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.289255 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.289218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mrtf4"]
Jul 14 01:08:29.292266 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.292244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.294869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.294841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 01:08:29.294977 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.294902    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fj5h2\""
Jul 14 01:08:29.304524 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.304502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mrtf4"]
Jul 14 01:08:29.352989 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.352942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.353219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.353021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdzl\" (UniqueName: \"kubernetes.io/projected/48c8bb7f-7ad5-4924-a52d-4575132cad43-kube-api-access-hzdzl\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.353219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.353043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c8bb7f-7ad5-4924-a52d-4575132cad43-tls-certs\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.353219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.353070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c8bb7f-7ad5-4924-a52d-4575132cad43-tmp\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.353219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.353097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrdg\" (UniqueName: \"kubernetes.io/projected/cb865568-f767-42cf-8e4a-419a6dab79c9-kube-api-access-jhrdg\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.355462 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.355442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48c8bb7f-7ad5-4924-a52d-4575132cad43-tmp\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.355649 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.355634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48c8bb7f-7ad5-4924-a52d-4575132cad43-tls-certs\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.366669 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.366647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdzl\" (UniqueName: \"kubernetes.io/projected/48c8bb7f-7ad5-4924-a52d-4575132cad43-kube-api-access-hzdzl\") pod \"kube-auth-proxy-6d697d898-p7psj\" (UID: \"48c8bb7f-7ad5-4924-a52d-4575132cad43\") " pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.457237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.457148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.457607 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:08:29.457585    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 01:08:29.457671 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:08:29.457660    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert podName:cb865568-f767-42cf-8e4a-419a6dab79c9 nodeName:}" failed. No retries permitted until 2026-07-14 01:08:29.957639589 +0000 UTC m=+503.358951060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert") pod "odh-model-controller-7998c67dc4-mrtf4" (UID: "cb865568-f767-42cf-8e4a-419a6dab79c9") : secret "odh-model-controller-webhook-cert" not found
Jul 14 01:08:29.457741 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.457724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrdg\" (UniqueName: \"kubernetes.io/projected/cb865568-f767-42cf-8e4a-419a6dab79c9-kube-api-access-jhrdg\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.471498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.471471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrdg\" (UniqueName: \"kubernetes.io/projected/cb865568-f767-42cf-8e4a-419a6dab79c9-kube-api-access-jhrdg\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.487409 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.487378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj"
Jul 14 01:08:29.625571 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.625482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d697d898-p7psj"]
Jul 14 01:08:29.628316 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:29.628291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c8bb7f_7ad5_4924_a52d_4575132cad43.slice/crio-bc5f9787052a34092ad66cc605ec8c087a03dac26ff38c64d3c7beb94c0acd9c WatchSource:0}: Error finding container bc5f9787052a34092ad66cc605ec8c087a03dac26ff38c64d3c7beb94c0acd9c: Status 404 returned error can't find the container with id bc5f9787052a34092ad66cc605ec8c087a03dac26ff38c64d3c7beb94c0acd9c
Jul 14 01:08:29.952074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.952041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj" event={"ID":"48c8bb7f-7ad5-4924-a52d-4575132cad43","Type":"ContainerStarted","Data":"bc5f9787052a34092ad66cc605ec8c087a03dac26ff38c64d3c7beb94c0acd9c"}
Jul 14 01:08:29.962366 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.962344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:29.964821 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:29.964803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cb865568-f767-42cf-8e4a-419a6dab79c9-cert\") pod \"odh-model-controller-7998c67dc4-mrtf4\" (UID: \"cb865568-f767-42cf-8e4a-419a6dab79c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:30.097061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.097028    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:30.101177 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.101160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.103549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.103525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 01:08:30.103641 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.103536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 01:08:30.103767 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.103753    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 01:08:30.104036 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.104019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 01:08:30.104091 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.104026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vv9bj\""
Jul 14 01:08:30.111383 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.111361    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:30.164662 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.164662 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.164904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.164904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.164904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl5nh\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.165061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.165061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.164971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.202433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.202348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:30.265898 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.265869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266035 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.265910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl5nh\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266103 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266175 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266214 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266214 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266363 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.266731 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.266704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.269102 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.269079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.269237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.269180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.269280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.269259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.269325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.269279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.273689 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.273662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.274465 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.274444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl5nh\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh\") pod \"istiod-openshift-gateway-7574459656-85249\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.332294 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.332265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mrtf4"]
Jul 14 01:08:30.334751 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:30.334723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb865568_f767_42cf_8e4a_419a6dab79c9.slice/crio-7297655d6169294c9b2e5519a3b459e09c9ee54964c01de459f28e771a886c00 WatchSource:0}: Error finding container 7297655d6169294c9b2e5519a3b459e09c9ee54964c01de459f28e771a886c00: Status 404 returned error can't find the container with id 7297655d6169294c9b2e5519a3b459e09c9ee54964c01de459f28e771a886c00
Jul 14 01:08:30.411265 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.411234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:30.557234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.557202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:30.560615 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:30.560577    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b2f608_1bc2_4e9d_9c2b_5530c835cb9d.slice/crio-893b30ea2c9695fa04bcb413df691dd5e70e0ce6a05af97f9121dcda582f6ccb WatchSource:0}: Error finding container 893b30ea2c9695fa04bcb413df691dd5e70e0ce6a05af97f9121dcda582f6ccb: Status 404 returned error can't find the container with id 893b30ea2c9695fa04bcb413df691dd5e70e0ce6a05af97f9121dcda582f6ccb
Jul 14 01:08:30.957642 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.957607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" event={"ID":"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d","Type":"ContainerStarted","Data":"893b30ea2c9695fa04bcb413df691dd5e70e0ce6a05af97f9121dcda582f6ccb"}
Jul 14 01:08:30.958621 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:30.958598    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4" event={"ID":"cb865568-f767-42cf-8e4a-419a6dab79c9","Type":"ContainerStarted","Data":"7297655d6169294c9b2e5519a3b459e09c9ee54964c01de459f28e771a886c00"}
Jul 14 01:08:35.055417 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.055385    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:08:35.055728 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.055450    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:08:35.986948 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.986914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj" event={"ID":"48c8bb7f-7ad5-4924-a52d-4575132cad43","Type":"ContainerStarted","Data":"e41e01ef2d856848cf94c2eb0ce1ec71eea461cc26028ff3e606ca4504c6dfa2"}
Jul 14 01:08:35.988639 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.988611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4" event={"ID":"cb865568-f767-42cf-8e4a-419a6dab79c9","Type":"ContainerStarted","Data":"a7fa89276f81a19155822e25a4cd31f917af4c0eb576fb851cb883380013bbc2"}
Jul 14 01:08:35.988789 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.988710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:08:35.990399 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.990365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" event={"ID":"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d","Type":"ContainerStarted","Data":"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"}
Jul 14 01:08:35.990512 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:35.990432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:36.004514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:36.004462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d697d898-p7psj" podStartSLOduration=1.57263759 podStartE2EDuration="7.004447803s" totalImagesPullingTime="5.431810213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:36.003547175 +0000 UTC m=+509.404858667" watchObservedRunningTime="2026-07-14 01:08:36.004447803 +0000 UTC m=+509.405759288"
Jul 14 01:08:36.035111 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:36.031134    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" podStartSLOduration=1.538644353 podStartE2EDuration="6.031083828s" totalImagesPullingTime="4.492439475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:36.030835239 +0000 UTC m=+509.432146723" watchObservedRunningTime="2026-07-14 01:08:36.031083828 +0000 UTC m=+509.432395319"
Jul 14 01:08:36.050812 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:36.050758    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4" podStartSLOduration=2.335093793 podStartE2EDuration="7.050740407s" totalImagesPullingTime="4.715646614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:36.050448368 +0000 UTC m=+509.451759859" watchObservedRunningTime="2026-07-14 01:08:36.050740407 +0000 UTC m=+509.452051900"
Jul 14 01:08:36.997113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:36.997080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:39.488025 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.487988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"]
Jul 14 01:08:39.491477 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.491446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.492752 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.492727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"]
Jul 14 01:08:39.494415 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.494397    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 01:08:39.494559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.494458    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8qkbh\""
Jul 14 01:08:39.496346 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.496329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.498969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.498950    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 01:08:39.498969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.498965    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vlfgs\""
Jul 14 01:08:39.509018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.508997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"]
Jul 14 01:08:39.514541 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.514515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"]
Jul 14 01:08:39.651183 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.651150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnpdm\" (UniqueName: \"kubernetes.io/projected/7e8e35e3-3476-4c51-abd2-8e981faa5acd-kube-api-access-pnpdm\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.651345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.651191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dff5f622-a47a-43ce-a9c4-1951025f1c11-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.651345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.651254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdfvd\" (UniqueName: \"kubernetes.io/projected/dff5f622-a47a-43ce-a9c4-1951025f1c11-kube-api-access-mdfvd\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.651345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.651331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e8e35e3-3476-4c51-abd2-8e981faa5acd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.752420 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.752333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dff5f622-a47a-43ce-a9c4-1951025f1c11-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.752420 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.752377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdfvd\" (UniqueName: \"kubernetes.io/projected/dff5f622-a47a-43ce-a9c4-1951025f1c11-kube-api-access-mdfvd\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.752596 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.752429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e8e35e3-3476-4c51-abd2-8e981faa5acd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.752596 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.752485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnpdm\" (UniqueName: \"kubernetes.io/projected/7e8e35e3-3476-4c51-abd2-8e981faa5acd-kube-api-access-pnpdm\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.754964 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.754933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dff5f622-a47a-43ce-a9c4-1951025f1c11-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.754964 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.754958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e8e35e3-3476-4c51-abd2-8e981faa5acd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.763668 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.763642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnpdm\" (UniqueName: \"kubernetes.io/projected/7e8e35e3-3476-4c51-abd2-8e981faa5acd-kube-api-access-pnpdm\") pod \"llmisvc-controller-manager-777c6bd7d5-hptf5\" (UID: \"7e8e35e3-3476-4c51-abd2-8e981faa5acd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.764553 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.764534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdfvd\" (UniqueName: \"kubernetes.io/projected/dff5f622-a47a-43ce-a9c4-1951025f1c11-kube-api-access-mdfvd\") pod \"kserve-controller-manager-d6f4b65b8-d7fq5\" (UID: \"dff5f622-a47a-43ce-a9c4-1951025f1c11\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.803566 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.803535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:39.809878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.809847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:39.947622 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.947588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"]
Jul 14 01:08:39.951504 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:39.951406    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff5f622_a47a_43ce_a9c4_1951025f1c11.slice/crio-85dba2a58ec5b78f1ff7b08939fec9413b851f8e392d7c67df14ff6b26e0e070 WatchSource:0}: Error finding container 85dba2a58ec5b78f1ff7b08939fec9413b851f8e392d7c67df14ff6b26e0e070: Status 404 returned error can't find the container with id 85dba2a58ec5b78f1ff7b08939fec9413b851f8e392d7c67df14ff6b26e0e070
Jul 14 01:08:39.971662 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:39.971635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"]
Jul 14 01:08:39.974675 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:08:39.974650    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e8e35e3_3476_4c51_abd2_8e981faa5acd.slice/crio-cca6e8688edf72e6a06b83581ab08fc47a43f85b98de055eaaecdcaa4e6d1685 WatchSource:0}: Error finding container cca6e8688edf72e6a06b83581ab08fc47a43f85b98de055eaaecdcaa4e6d1685: Status 404 returned error can't find the container with id cca6e8688edf72e6a06b83581ab08fc47a43f85b98de055eaaecdcaa4e6d1685
Jul 14 01:08:40.007963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:40.007865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5" event={"ID":"dff5f622-a47a-43ce-a9c4-1951025f1c11","Type":"ContainerStarted","Data":"85dba2a58ec5b78f1ff7b08939fec9413b851f8e392d7c67df14ff6b26e0e070"}
Jul 14 01:08:40.008978 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:40.008953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5" event={"ID":"7e8e35e3-3476-4c51-abd2-8e981faa5acd","Type":"ContainerStarted","Data":"cca6e8688edf72e6a06b83581ab08fc47a43f85b98de055eaaecdcaa4e6d1685"}
Jul 14 01:08:42.068433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.068401    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:42.068891 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.068643    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" podUID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" containerName="discovery" containerID="cri-o://1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb" gracePeriod=30
Jul 14 01:08:42.328985 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.328934    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:42.475533 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475533 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl5nh\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475603    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.475980 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.475826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts\") pod \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\" (UID: \"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d\") "
Jul 14 01:08:42.476039 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.476014    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:08:42.476537 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.476168    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-ca-configmap\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.478631 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.478601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts" (OuterVolumeSpecName: "cacerts") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:08:42.478732 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.478622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:08:42.478732 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.478641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh" (OuterVolumeSpecName: "kube-api-access-fl5nh") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "kube-api-access-fl5nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:08:42.478732 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.478691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs" (OuterVolumeSpecName: "local-certs") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:08:42.479025 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.479007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:08:42.479025 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.479013    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" (UID: "e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:08:42.577488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577449    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-csr-dns-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.577488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577479    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl5nh\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-kube-api-access-fl5nh\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.577488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577488    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-kubeconfig\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.577488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577497    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-local-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.577737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577507    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-istio-token\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:42.577737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:42.577515    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d-cacerts\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:08:43.025154 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.025100    2565 generic.go:356] "Generic (PLEG): container finished" podID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" containerID="1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb" exitCode=0
Jul 14 01:08:43.025335 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.025175    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249"
Jul 14 01:08:43.025335 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.025192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" event={"ID":"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d","Type":"ContainerDied","Data":"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"}
Jul 14 01:08:43.025335 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.025260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-85249" event={"ID":"e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d","Type":"ContainerDied","Data":"893b30ea2c9695fa04bcb413df691dd5e70e0ce6a05af97f9121dcda582f6ccb"}
Jul 14 01:08:43.025335 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.025291    2565 scope.go:117] "RemoveContainer" containerID="1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"
Jul 14 01:08:43.066799 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.066767    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:43.073788 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.073754    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-85249"]
Jul 14 01:08:43.171868 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.171830    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" path="/var/lib/kubelet/pods/e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d/volumes"
Jul 14 01:08:43.469884 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.469712    2565 scope.go:117] "RemoveContainer" containerID="1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"
Jul 14 01:08:43.470096 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:08:43.470073    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb\": container with ID starting with 1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb not found: ID does not exist" containerID="1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"
Jul 14 01:08:43.470165 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:43.470106    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb"} err="failed to get container status \"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb\": rpc error: code = NotFound desc = could not find container \"1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb\": container with ID starting with 1ce70ad6ae6915ea647a282ae9dc0d4c3af43f4c611c6a61d95f4805aad384fb not found: ID does not exist"
Jul 14 01:08:45.035709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.035673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5" event={"ID":"7e8e35e3-3476-4c51-abd2-8e981faa5acd","Type":"ContainerStarted","Data":"19f7f3fdc838019f6da64123a6650d6ecdd651e494cb24fd32e8214f629da1cd"}
Jul 14 01:08:45.036199 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.035742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:08:45.037074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.037048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5" event={"ID":"dff5f622-a47a-43ce-a9c4-1951025f1c11","Type":"ContainerStarted","Data":"4c652a41ff2976b416c79fb4458eed1f399ebb9d34e261c11f5800d9faafffc4"}
Jul 14 01:08:45.037182 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.037166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:08:45.055615 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.055565    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5" podStartSLOduration=1.9739604910000002 podStartE2EDuration="6.055549115s" totalImagesPullingTime="4.081588624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:45.054335409 +0000 UTC m=+518.455646899" watchObservedRunningTime="2026-07-14 01:08:45.055549115 +0000 UTC m=+518.456860605"
Jul 14 01:08:45.071075 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:45.071029    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5" podStartSLOduration=1.969528242 podStartE2EDuration="6.071008234s" totalImagesPullingTime="4.101479992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:45.070504459 +0000 UTC m=+518.471815950" watchObservedRunningTime="2026-07-14 01:08:45.071008234 +0000 UTC m=+518.472319727"
Jul 14 01:08:46.998191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:08:46.998163    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mrtf4"
Jul 14 01:09:16.043470 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:16.043443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hptf5"
Jul 14 01:09:16.046825 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:16.046799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7fq5"
Jul 14 01:09:30.096667 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.096636    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:30.097078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.096948    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" containerName="discovery"
Jul 14 01:09:30.097078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.096960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" containerName="discovery"
Jul 14 01:09:30.097078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.097014    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b2f608-1bc2-4e9d-9c2b-5530c835cb9d" containerName="discovery"
Jul 14 01:09:30.099682 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.099656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:30.102557 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.102534    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 01:09:30.102690 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.102576    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 01:09:30.103651 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.103635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-26q5n\""
Jul 14 01:09:30.108054 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.108021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:30.282265 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.282233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hr8x\" (UniqueName: \"kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x\") pod \"kuadrant-operator-catalog-84gnr\" (UID: \"1c26da26-4e22-48bd-a571-d2c53ed6a7c9\") " pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:30.383218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.383112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hr8x\" (UniqueName: \"kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x\") pod \"kuadrant-operator-catalog-84gnr\" (UID: \"1c26da26-4e22-48bd-a571-d2c53ed6a7c9\") " pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:30.391563 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.391527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hr8x\" (UniqueName: \"kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x\") pod \"kuadrant-operator-catalog-84gnr\" (UID: \"1c26da26-4e22-48bd-a571-d2c53ed6a7c9\") " pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:30.410755 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.410728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:30.468279 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.468247    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:30.543055 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.543027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:30.545869 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:09:30.545844    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c26da26_4e22_48bd_a571_d2c53ed6a7c9.slice/crio-22851feed5a7a84c6521fd9909f6e97e9b8a5777c419583fd6af9db9e1ac12e2 WatchSource:0}: Error finding container 22851feed5a7a84c6521fd9909f6e97e9b8a5777c419583fd6af9db9e1ac12e2: Status 404 returned error can't find the container with id 22851feed5a7a84c6521fd9909f6e97e9b8a5777c419583fd6af9db9e1ac12e2
Jul 14 01:09:30.678388 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.678312    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmfl2"]
Jul 14 01:09:30.682440 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.682425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:30.689668 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.689368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmfl2"]
Jul 14 01:09:30.786772 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.786738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrtxx\" (UniqueName: \"kubernetes.io/projected/3d6e0718-dd46-4544-a38a-703b84d699e6-kube-api-access-nrtxx\") pod \"kuadrant-operator-catalog-qmfl2\" (UID: \"3d6e0718-dd46-4544-a38a-703b84d699e6\") " pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:30.888040 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.888011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrtxx\" (UniqueName: \"kubernetes.io/projected/3d6e0718-dd46-4544-a38a-703b84d699e6-kube-api-access-nrtxx\") pod \"kuadrant-operator-catalog-qmfl2\" (UID: \"3d6e0718-dd46-4544-a38a-703b84d699e6\") " pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:30.897370 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.897350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrtxx\" (UniqueName: \"kubernetes.io/projected/3d6e0718-dd46-4544-a38a-703b84d699e6-kube-api-access-nrtxx\") pod \"kuadrant-operator-catalog-qmfl2\" (UID: \"3d6e0718-dd46-4544-a38a-703b84d699e6\") " pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:30.992604 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:30.992512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:31.142729 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:31.142657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qmfl2"]
Jul 14 01:09:31.145424 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:09:31.145390    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6e0718_dd46_4544_a38a_703b84d699e6.slice/crio-fb4293c6b028f790dc1c3b2c91e6fcf4f4d564ade7e4ebba96c631c00bd1fbf9 WatchSource:0}: Error finding container fb4293c6b028f790dc1c3b2c91e6fcf4f4d564ade7e4ebba96c631c00bd1fbf9: Status 404 returned error can't find the container with id fb4293c6b028f790dc1c3b2c91e6fcf4f4d564ade7e4ebba96c631c00bd1fbf9
Jul 14 01:09:31.222918 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:31.222889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" event={"ID":"1c26da26-4e22-48bd-a571-d2c53ed6a7c9","Type":"ContainerStarted","Data":"22851feed5a7a84c6521fd9909f6e97e9b8a5777c419583fd6af9db9e1ac12e2"}
Jul 14 01:09:31.224006 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:31.223986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2" event={"ID":"3d6e0718-dd46-4544-a38a-703b84d699e6","Type":"ContainerStarted","Data":"fb4293c6b028f790dc1c3b2c91e6fcf4f4d564ade7e4ebba96c631c00bd1fbf9"}
Jul 14 01:09:33.235924 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.235824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" event={"ID":"1c26da26-4e22-48bd-a571-d2c53ed6a7c9","Type":"ContainerStarted","Data":"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"}
Jul 14 01:09:33.235924 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.235884    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" podUID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" containerName="registry-server" containerID="cri-o://93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7" gracePeriod=2
Jul 14 01:09:33.237582 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.237555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2" event={"ID":"3d6e0718-dd46-4544-a38a-703b84d699e6","Type":"ContainerStarted","Data":"0a892d497ab93f1d271f31a5e0355f27b5a24f64dfbe5902688d0e9fad32d6b3"}
Jul 14 01:09:33.250751 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.250699    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" podStartSLOduration=1.009412335 podStartE2EDuration="3.250677643s" totalImagesPullingTime="2.241265308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:33.249704328 +0000 UTC m=+566.651015818" watchObservedRunningTime="2026-07-14 01:09:33.250677643 +0000 UTC m=+566.651989134"
Jul 14 01:09:33.475714 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.475692    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:33.491544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.491451    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2" podStartSLOduration=1.846625767 podStartE2EDuration="3.491430985s" totalImagesPullingTime="1.644805218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:33.262948169 +0000 UTC m=+566.664259660" watchObservedRunningTime="2026-07-14 01:09:33.491430985 +0000 UTC m=+566.892742476"
Jul 14 01:09:33.612650 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.612614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hr8x\" (UniqueName: \"kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x\") pod \"1c26da26-4e22-48bd-a571-d2c53ed6a7c9\" (UID: \"1c26da26-4e22-48bd-a571-d2c53ed6a7c9\") "
Jul 14 01:09:33.614870 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.614848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x" (OuterVolumeSpecName: "kube-api-access-8hr8x") pod "1c26da26-4e22-48bd-a571-d2c53ed6a7c9" (UID: "1c26da26-4e22-48bd-a571-d2c53ed6a7c9"). InnerVolumeSpecName "kube-api-access-8hr8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:09:33.713576 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:33.713546    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hr8x\" (UniqueName: \"kubernetes.io/projected/1c26da26-4e22-48bd-a571-d2c53ed6a7c9-kube-api-access-8hr8x\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:09:34.243449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.243359    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" containerID="93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7" exitCode=0
Jul 14 01:09:34.243449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.243405    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-84gnr"
Jul 14 01:09:34.243900 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.243451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" event={"ID":"1c26da26-4e22-48bd-a571-d2c53ed6a7c9","Type":"ContainerDied","Data":"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"}
Jul 14 01:09:34.243900 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.243491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-84gnr" event={"ID":"1c26da26-4e22-48bd-a571-d2c53ed6a7c9","Type":"ContainerDied","Data":"22851feed5a7a84c6521fd9909f6e97e9b8a5777c419583fd6af9db9e1ac12e2"}
Jul 14 01:09:34.243900 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.243509    2565 scope.go:117] "RemoveContainer" containerID="93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"
Jul 14 01:09:34.258367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.258350    2565 scope.go:117] "RemoveContainer" containerID="93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"
Jul 14 01:09:34.258634 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:09:34.258617    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7\": container with ID starting with 93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7 not found: ID does not exist" containerID="93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"
Jul 14 01:09:34.258688 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.258642    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7"} err="failed to get container status \"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7\": rpc error: code = NotFound desc = could not find container \"93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7\": container with ID starting with 93e19519b26aebce156512669902b1f399519674469d3135a5abbd52eecc2dd7 not found: ID does not exist"
Jul 14 01:09:34.266681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.266662    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:34.270443 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:34.270426    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-84gnr"]
Jul 14 01:09:35.169793 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:35.169757    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" path="/var/lib/kubelet/pods/1c26da26-4e22-48bd-a571-d2c53ed6a7c9/volumes"
Jul 14 01:09:40.992825 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:40.992789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:40.993286 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:40.992852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:41.015730 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:41.015707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:41.295341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:41.295314    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qmfl2"
Jul 14 01:09:58.304180 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.304147    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"]
Jul 14 01:09:58.304631 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.304453    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" containerName="registry-server"
Jul 14 01:09:58.304631 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.304463    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" containerName="registry-server"
Jul 14 01:09:58.304631 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.304530    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c26da26-4e22-48bd-a571-d2c53ed6a7c9" containerName="registry-server"
Jul 14 01:09:58.309034 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.309016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.311533 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.311506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrt4w\""
Jul 14 01:09:58.320211 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.320189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"]
Jul 14 01:09:58.418144 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.418088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.418315 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.418156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqb8w\" (UniqueName: \"kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.518755 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.518718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.518914 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.518787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqb8w\" (UniqueName: \"kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.519230 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.519213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.533026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.533003    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqb8w\" (UniqueName: \"kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.619763 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.619674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:09:58.753637 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:58.753601    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"]
Jul 14 01:09:58.757713 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:09:58.757686    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4371190d_4a74_417c_88dd_a0248dab5e33.slice/crio-4e7789eb90bb37bad35da5e1732952c1b6faf5a63336ef63fb1d2336929b4acb WatchSource:0}: Error finding container 4e7789eb90bb37bad35da5e1732952c1b6faf5a63336ef63fb1d2336929b4acb: Status 404 returned error can't find the container with id 4e7789eb90bb37bad35da5e1732952c1b6faf5a63336ef63fb1d2336929b4acb
Jul 14 01:09:59.014293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.014216    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dffdb586f-dpn22"]
Jul 14 01:09:59.017611 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.017591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.020231 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.020212    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 01:09:59.021162 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.021102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zqnn7\""
Jul 14 01:09:59.021474 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.021318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 01:09:59.021474 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.021384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 01:09:59.021474 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.021412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 01:09:59.021474 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.021421    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 01:09:59.025179 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.025154    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 01:09:59.030960 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.030937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dffdb586f-dpn22"]
Jul 14 01:09:59.124084 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-trusted-ca-bundle\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-oauth-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-oauth-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-service-ca\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124490 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvtdp\" (UniqueName: \"kubernetes.io/projected/86d5aa89-3b90-475d-bd40-b7af32c0a973-kube-api-access-gvtdp\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.124490 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.124413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225584 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225584 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-oauth-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-oauth-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-service-ca\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvtdp\" (UniqueName: \"kubernetes.io/projected/86d5aa89-3b90-475d-bd40-b7af32c0a973-kube-api-access-gvtdp\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.225834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.225772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-trusted-ca-bundle\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.226427 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.226402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.226550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.226499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-service-ca\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.226627 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.226611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-oauth-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.227039 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.227016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86d5aa89-3b90-475d-bd40-b7af32c0a973-trusted-ca-bundle\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.228322 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.228299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-oauth-config\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.228458 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.228440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86d5aa89-3b90-475d-bd40-b7af32c0a973-console-serving-cert\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.233448 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.233427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvtdp\" (UniqueName: \"kubernetes.io/projected/86d5aa89-3b90-475d-bd40-b7af32c0a973-kube-api-access-gvtdp\") pod \"console-5dffdb586f-dpn22\" (UID: \"86d5aa89-3b90-475d-bd40-b7af32c0a973\") " pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.328977 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.328938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:09:59.350212 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.350184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk" event={"ID":"4371190d-4a74-417c-88dd-a0248dab5e33","Type":"ContainerStarted","Data":"4e7789eb90bb37bad35da5e1732952c1b6faf5a63336ef63fb1d2336929b4acb"}
Jul 14 01:09:59.463953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:09:59.463927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dffdb586f-dpn22"]
Jul 14 01:09:59.468140 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:09:59.468078    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d5aa89_3b90_475d_bd40_b7af32c0a973.slice/crio-7ea63671d305677038f225b4ef7b6dfa62cb560b26c5aa5a7a604ce84efda028 WatchSource:0}: Error finding container 7ea63671d305677038f225b4ef7b6dfa62cb560b26c5aa5a7a604ce84efda028: Status 404 returned error can't find the container with id 7ea63671d305677038f225b4ef7b6dfa62cb560b26c5aa5a7a604ce84efda028
Jul 14 01:10:00.356151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.356101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dffdb586f-dpn22" event={"ID":"86d5aa89-3b90-475d-bd40-b7af32c0a973","Type":"ContainerStarted","Data":"a3942218f2f85e381cf153c4a3db85076cda5db7c4f7c3015ee4d0b407a1d394"}
Jul 14 01:10:00.356603 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.356411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dffdb586f-dpn22" event={"ID":"86d5aa89-3b90-475d-bd40-b7af32c0a973","Type":"ContainerStarted","Data":"7ea63671d305677038f225b4ef7b6dfa62cb560b26c5aa5a7a604ce84efda028"}
Jul 14 01:10:00.385423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.385345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dffdb586f-dpn22" podStartSLOduration=2.385327695 podStartE2EDuration="2.385327695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:00.383537253 +0000 UTC m=+593.784848744" watchObservedRunningTime="2026-07-14 01:10:00.385327695 +0000 UTC m=+593.786639185"
Jul 14 01:10:00.835848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.835810    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"]
Jul 14 01:10:00.839306 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.839289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:00.842061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.842038    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 14 01:10:00.842339 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.842323    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6x54q\""
Jul 14 01:10:00.849606 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.849583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"]
Jul 14 01:10:00.940804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:00.940767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn5lb\" (UniqueName: \"kubernetes.io/projected/3088855b-8315-4cff-8d66-1c1d3ecf2b84-kube-api-access-hn5lb\") pod \"dns-operator-controller-manager-864dd78c4c-d6sjv\" (UID: \"3088855b-8315-4cff-8d66-1c1d3ecf2b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:01.041948 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:01.041902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn5lb\" (UniqueName: \"kubernetes.io/projected/3088855b-8315-4cff-8d66-1c1d3ecf2b84-kube-api-access-hn5lb\") pod \"dns-operator-controller-manager-864dd78c4c-d6sjv\" (UID: \"3088855b-8315-4cff-8d66-1c1d3ecf2b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:01.053620 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:01.053582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn5lb\" (UniqueName: \"kubernetes.io/projected/3088855b-8315-4cff-8d66-1c1d3ecf2b84-kube-api-access-hn5lb\") pod \"dns-operator-controller-manager-864dd78c4c-d6sjv\" (UID: \"3088855b-8315-4cff-8d66-1c1d3ecf2b84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:01.151186 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:01.151088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:01.292253 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:01.292220    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"]
Jul 14 01:10:01.297817 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:01.297768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3088855b_8315_4cff_8d66_1c1d3ecf2b84.slice/crio-7934ede31c386a905a27cf34d5da54675f74dd020ffffad0e7d76b0b00ca135a WatchSource:0}: Error finding container 7934ede31c386a905a27cf34d5da54675f74dd020ffffad0e7d76b0b00ca135a: Status 404 returned error can't find the container with id 7934ede31c386a905a27cf34d5da54675f74dd020ffffad0e7d76b0b00ca135a
Jul 14 01:10:01.362710 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:01.362676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv" event={"ID":"3088855b-8315-4cff-8d66-1c1d3ecf2b84","Type":"ContainerStarted","Data":"7934ede31c386a905a27cf34d5da54675f74dd020ffffad0e7d76b0b00ca135a"}
Jul 14 01:10:04.172191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.172154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"]
Jul 14 01:10:04.175980 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.175952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:04.178320 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.178293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hkdj7\""
Jul 14 01:10:04.184589 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.184564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"]
Jul 14 01:10:04.274703 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.274667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvl8\" (UniqueName: \"kubernetes.io/projected/3cf5eb34-a547-42af-9457-73c3eda2299f-kube-api-access-spvl8\") pod \"authorino-operator-75cc8d5cb7-6jqxc\" (UID: \"3cf5eb34-a547-42af-9457-73c3eda2299f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:04.375891 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.375855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvl8\" (UniqueName: \"kubernetes.io/projected/3cf5eb34-a547-42af-9457-73c3eda2299f-kube-api-access-spvl8\") pod \"authorino-operator-75cc8d5cb7-6jqxc\" (UID: \"3cf5eb34-a547-42af-9457-73c3eda2299f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:04.388942 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.388900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvl8\" (UniqueName: \"kubernetes.io/projected/3cf5eb34-a547-42af-9457-73c3eda2299f-kube-api-access-spvl8\") pod \"authorino-operator-75cc8d5cb7-6jqxc\" (UID: \"3cf5eb34-a547-42af-9457-73c3eda2299f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:04.489236 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:04.489146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:05.076746 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.076598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"]
Jul 14 01:10:05.079777 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:05.079750    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf5eb34_a547_42af_9457_73c3eda2299f.slice/crio-296a434a5150c4fa113265a3a047c22e28df7d007ff3d156d8fa114c8d3d76d7 WatchSource:0}: Error finding container 296a434a5150c4fa113265a3a047c22e28df7d007ff3d156d8fa114c8d3d76d7: Status 404 returned error can't find the container with id 296a434a5150c4fa113265a3a047c22e28df7d007ff3d156d8fa114c8d3d76d7
Jul 14 01:10:05.384800 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.384758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc" event={"ID":"3cf5eb34-a547-42af-9457-73c3eda2299f","Type":"ContainerStarted","Data":"296a434a5150c4fa113265a3a047c22e28df7d007ff3d156d8fa114c8d3d76d7"}
Jul 14 01:10:05.386293 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.386269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv" event={"ID":"3088855b-8315-4cff-8d66-1c1d3ecf2b84","Type":"ContainerStarted","Data":"0a74b27c341168abd198482feac46001d0477d515420ff8d781a5dc21c5833b4"}
Jul 14 01:10:05.386432 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.386390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:05.387891 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.387872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk" event={"ID":"4371190d-4a74-417c-88dd-a0248dab5e33","Type":"ContainerStarted","Data":"d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2"}
Jul 14 01:10:05.388027 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.387984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:05.410974 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.410917    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv" podStartSLOduration=1.776974972 podStartE2EDuration="5.410900514s" totalImagesPullingTime="3.633925542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:05.409417499 +0000 UTC m=+598.810728991" watchObservedRunningTime="2026-07-14 01:10:05.410900514 +0000 UTC m=+598.812212005"
Jul 14 01:10:05.427909 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:05.427853    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk" podStartSLOduration=1.237891411 podStartE2EDuration="7.427836203s" totalImagesPullingTime="6.189944792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:05.427065108 +0000 UTC m=+598.828376590" watchObservedRunningTime="2026-07-14 01:10:05.427836203 +0000 UTC m=+598.829147696"
Jul 14 01:10:06.781559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:06.781518    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"]
Jul 14 01:10:06.790010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:06.789980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:06.792550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:06.792507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r6655\""
Jul 14 01:10:06.792744 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:06.792605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"]
Jul 14 01:10:06.901445 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:06.901387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrgn\" (UniqueName: \"kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-6blvp\" (UID: \"f9b1a382-a1fc-4038-b837-06aae47694fd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:07.002762 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.002724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrgn\" (UniqueName: \"kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-6blvp\" (UID: \"f9b1a382-a1fc-4038-b837-06aae47694fd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:07.010940 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.010903    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrgn\" (UniqueName: \"kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-6blvp\" (UID: \"f9b1a382-a1fc-4038-b837-06aae47694fd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:07.108356 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.108328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r6655\""
Jul 14 01:10:07.116619 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.116590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:07.365269 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.365245    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:10:07.365498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.365483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:10:07.373713 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.373692    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:10:07.373869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.373857    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:10:07.483705 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:07.478834    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"]
Jul 14 01:10:07.741105 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:07.741035    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b1a382_a1fc_4038_b837_06aae47694fd.slice/crio-1c7da600c9a199e8772319cf16608ede682337fca9b6de297b9068b54b85f412 WatchSource:0}: Error finding container 1c7da600c9a199e8772319cf16608ede682337fca9b6de297b9068b54b85f412: Status 404 returned error can't find the container with id 1c7da600c9a199e8772319cf16608ede682337fca9b6de297b9068b54b85f412
Jul 14 01:10:08.405415 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:08.405380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp" event={"ID":"f9b1a382-a1fc-4038-b837-06aae47694fd","Type":"ContainerStarted","Data":"1c7da600c9a199e8772319cf16608ede682337fca9b6de297b9068b54b85f412"}
Jul 14 01:10:08.407809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:08.406857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc" event={"ID":"3cf5eb34-a547-42af-9457-73c3eda2299f","Type":"ContainerStarted","Data":"511c36db12e8cd17a1a611bf3889e64209cf1df53de58f7eca02d72bd1a5d79f"}
Jul 14 01:10:08.407809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:08.406984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:08.422708 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:08.422666    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc" podStartSLOduration=1.7113435799999999 podStartE2EDuration="4.422653509s" totalImagesPullingTime="2.711309929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:08.421764991 +0000 UTC m=+601.823076481" watchObservedRunningTime="2026-07-14 01:10:08.422653509 +0000 UTC m=+601.823964999"
Jul 14 01:10:09.329344 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:09.329304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:10:09.329534 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:09.329396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:10:09.334384 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:09.334361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:10:09.414647 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:09.414621    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dffdb586f-dpn22"
Jul 14 01:10:11.427036 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:11.427003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp" event={"ID":"f9b1a382-a1fc-4038-b837-06aae47694fd","Type":"ContainerStarted","Data":"e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314"}
Jul 14 01:10:11.427439 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:11.427100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:11.443468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:11.443407    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp" podStartSLOduration=1.8898872610000002 podStartE2EDuration="5.443389465s" totalImagesPullingTime="3.553502204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:11.442622287 +0000 UTC m=+604.843933780" watchObservedRunningTime="2026-07-14 01:10:11.443389465 +0000 UTC m=+604.844700958"
Jul 14 01:10:16.395602 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:16.395572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d6sjv"
Jul 14 01:10:16.395984 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:16.395642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.135304 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.135269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"]
Jul 14 01:10:18.135706 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.135486    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" containerName="manager" containerID="cri-o://d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2" gracePeriod=2
Jul 14 01:10:18.147768 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.147726    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"]
Jul 14 01:10:18.154399 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.154356    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4371190d-4a74-417c-88dd-a0248dab5e33\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\": pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.162921 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.162897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:18.163459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.163441    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" containerName="manager"
Jul 14 01:10:18.163527 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.163462    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" containerName="manager"
Jul 14 01:10:18.163589 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.163578    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" containerName="manager"
Jul 14 01:10:18.166800 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.166782    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"]
Jul 14 01:10:18.166920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.166903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.166994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.166957    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" containerName="manager" containerID="cri-o://e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314" gracePeriod=2
Jul 14 01:10:18.168993 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.168966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.171981 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.171885    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"]
Jul 14 01:10:18.183636 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.183605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:18.185892 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.185870    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"]
Jul 14 01:10:18.186316 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.186293    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" containerName="manager"
Jul 14 01:10:18.186316 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.186316    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" containerName="manager"
Jul 14 01:10:18.186491 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.186398    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" containerName="manager"
Jul 14 01:10:18.191608 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.191589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:18.198463 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.198433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"]
Jul 14 01:10:18.201392 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.201351    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.203569 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.203538    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.205860 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.205830    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.223746 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.223703    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.303738 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.303697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95ds\" (UniqueName: \"kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.303879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.303764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9fj\" (UniqueName: \"kubernetes.io/projected/4869964f-caff-4ee9-aa8f-2d1de6e59c66-kube-api-access-nt9fj\") pod \"limitador-operator-controller-manager-859d7b78bd-t8g2x\" (UID: \"4869964f-caff-4ee9-aa8f-2d1de6e59c66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:18.303879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.303783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.405014 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.404987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9fj\" (UniqueName: \"kubernetes.io/projected/4869964f-caff-4ee9-aa8f-2d1de6e59c66-kube-api-access-nt9fj\") pod \"limitador-operator-controller-manager-859d7b78bd-t8g2x\" (UID: \"4869964f-caff-4ee9-aa8f-2d1de6e59c66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:18.405111 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.405028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.405111 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.405095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95ds\" (UniqueName: \"kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.405447 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.405425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.414002 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.413979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95ds\" (UniqueName: \"kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hbp4l\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.414115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.414069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9fj\" (UniqueName: \"kubernetes.io/projected/4869964f-caff-4ee9-aa8f-2d1de6e59c66-kube-api-access-nt9fj\") pod \"limitador-operator-controller-manager-859d7b78bd-t8g2x\" (UID: \"4869964f-caff-4ee9-aa8f-2d1de6e59c66\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:18.414491 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.414474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.416455 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.416431    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.416587 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.416573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.418223 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.418191    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.420306 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.420284    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.422271 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.422246    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.460708 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.460680    2565 generic.go:356] "Generic (PLEG): container finished" podID="4371190d-4a74-417c-88dd-a0248dab5e33" containerID="d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2" exitCode=0
Jul 14 01:10:18.460846 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.460719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.460846 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.460787    2565 scope.go:117] "RemoveContainer" containerID="d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2"
Jul 14 01:10:18.462139 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.462105    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9b1a382-a1fc-4038-b837-06aae47694fd" containerID="e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314" exitCode=0
Jul 14 01:10:18.462242 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.462170    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.462910 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.462876    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.464600 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.464580    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.466541 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.466518    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.468301 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.468279    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.469723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.469695    2565 scope.go:117] "RemoveContainer" containerID="d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2"
Jul 14 01:10:18.469961 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.469943    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2\": container with ID starting with d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2 not found: ID does not exist" containerID="d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2"
Jul 14 01:10:18.470012 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.469970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2"} err="failed to get container status \"d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2\": rpc error: code = NotFound desc = could not find container \"d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2\": container with ID starting with d1f0c6d9d7da90e2052900ccec94407d5b58505b0578793c8d7a47ffecf859c2 not found: ID does not exist"
Jul 14 01:10:18.470012 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.469987    2565 scope.go:117] "RemoveContainer" containerID="e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314"
Jul 14 01:10:18.477638 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.477623    2565 scope.go:117] "RemoveContainer" containerID="e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314"
Jul 14 01:10:18.477887 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.477870    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314\": container with ID starting with e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314 not found: ID does not exist" containerID="e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314"
Jul 14 01:10:18.477934 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.477892    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314"} err="failed to get container status \"e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314\": rpc error: code = NotFound desc = could not find container \"e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314\": container with ID starting with e659c2db4d3c6c0049100ad9d1f5f8f1573c5a1d08978cc1e19738f3bba47314 not found: ID does not exist"
Jul 14 01:10:18.506275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.506251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume\") pod \"4371190d-4a74-417c-88dd-a0248dab5e33\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") "
Jul 14 01:10:18.506369 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.506280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdrgn\" (UniqueName: \"kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn\") pod \"f9b1a382-a1fc-4038-b837-06aae47694fd\" (UID: \"f9b1a382-a1fc-4038-b837-06aae47694fd\") "
Jul 14 01:10:18.506369 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.506322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqb8w\" (UniqueName: \"kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w\") pod \"4371190d-4a74-417c-88dd-a0248dab5e33\" (UID: \"4371190d-4a74-417c-88dd-a0248dab5e33\") "
Jul 14 01:10:18.506593 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.506572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4371190d-4a74-417c-88dd-a0248dab5e33" (UID: "4371190d-4a74-417c-88dd-a0248dab5e33"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:10:18.508410 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.508388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w" (OuterVolumeSpecName: "kube-api-access-bqb8w") pod "4371190d-4a74-417c-88dd-a0248dab5e33" (UID: "4371190d-4a74-417c-88dd-a0248dab5e33"). InnerVolumeSpecName "kube-api-access-bqb8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:10:18.508410 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.508396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn" (OuterVolumeSpecName: "kube-api-access-fdrgn") pod "f9b1a382-a1fc-4038-b837-06aae47694fd" (UID: "f9b1a382-a1fc-4038-b837-06aae47694fd"). InnerVolumeSpecName "kube-api-access-fdrgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:10:18.573235 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.573203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:18.580647 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.580632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:18.607678 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.607640    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4371190d-4a74-417c-88dd-a0248dab5e33-extensions-socket-volume\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:10:18.607678 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.607670    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdrgn\" (UniqueName: \"kubernetes.io/projected/f9b1a382-a1fc-4038-b837-06aae47694fd-kube-api-access-fdrgn\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:10:18.607678 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.607680    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqb8w\" (UniqueName: \"kubernetes.io/projected/4371190d-4a74-417c-88dd-a0248dab5e33-kube-api-access-bqb8w\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:10:18.723285 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.723259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:18.725339 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:18.725304    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda700b757_f8d7_489d_9373_4e6ce26482e0.slice/crio-56df4aa50ac06d16940cd38db48252e2df77c5fe9b075e78ce1917bf5fe91271 WatchSource:0}: Error finding container 56df4aa50ac06d16940cd38db48252e2df77c5fe9b075e78ce1917bf5fe91271: Status 404 returned error can't find the container with id 56df4aa50ac06d16940cd38db48252e2df77c5fe9b075e78ce1917bf5fe91271
Jul 14 01:10:18.742780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:18.742755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"]
Jul 14 01:10:18.745255 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:18.745228    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4869964f_caff_4ee9_aa8f_2d1de6e59c66.slice/crio-6fac20ee18126e94c02409a34503002b8419e299b49328c8ed3ad9104843be28 WatchSource:0}: Error finding container 6fac20ee18126e94c02409a34503002b8419e299b49328c8ed3ad9104843be28: Status 404 returned error can't find the container with id 6fac20ee18126e94c02409a34503002b8419e299b49328c8ed3ad9104843be28
Jul 14 01:10:18.779677 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.779641    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.781756 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.781732    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:18.783641 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.783606    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:18.785591 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:18.785561    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:19.055885 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.055847    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:10:19.059170 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.059154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.071731 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.071704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:10:19.084998 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:19.084963    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6blvp\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6blvp"
Jul 14 01:10:19.087382 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:19.087360    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sdqvk\" is forbidden: User \"system:node:ip-10-0-137-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-153.ec2.internal' and this object" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sdqvk"
Jul 14 01:10:19.170345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.170315    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4371190d-4a74-417c-88dd-a0248dab5e33" path="/var/lib/kubelet/pods/4371190d-4a74-417c-88dd-a0248dab5e33/volumes"
Jul 14 01:10:19.170654 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.170630    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b1a382-a1fc-4038-b837-06aae47694fd" path="/var/lib/kubelet/pods/f9b1a382-a1fc-4038-b837-06aae47694fd/volumes"
Jul 14 01:10:19.213865 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.213833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.214026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.213882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbdc\" (UniqueName: \"kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.315287 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.315191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbdc\" (UniqueName: \"kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.315426 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.315290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.315617 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.315601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.323062 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.323034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbdc\" (UniqueName: \"kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc\") pod \"kuadrant-operator-controller-manager-86878c769f-rn267\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.368869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.368833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:19.417408 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.417369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6jqxc"
Jul 14 01:10:19.471101 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.471071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x" event={"ID":"4869964f-caff-4ee9-aa8f-2d1de6e59c66","Type":"ContainerStarted","Data":"f4bff9d2e687c17fcd00eb7f5ec36886a91170d1ec14e0229ec3d7b882b1b4de"}
Jul 14 01:10:19.471261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.471157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x" event={"ID":"4869964f-caff-4ee9-aa8f-2d1de6e59c66","Type":"ContainerStarted","Data":"6fac20ee18126e94c02409a34503002b8419e299b49328c8ed3ad9104843be28"}
Jul 14 01:10:19.471261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.471234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:19.475569 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.475509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" event={"ID":"a700b757-f8d7-489d-9373-4e6ce26482e0","Type":"ContainerStarted","Data":"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"}
Jul 14 01:10:19.475720 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.475595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:19.475720 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.475618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" event={"ID":"a700b757-f8d7-489d-9373-4e6ce26482e0","Type":"ContainerStarted","Data":"56df4aa50ac06d16940cd38db48252e2df77c5fe9b075e78ce1917bf5fe91271"}
Jul 14 01:10:19.490355 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.490293    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x" podStartSLOduration=1.490270327 podStartE2EDuration="1.490270327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:19.489036058 +0000 UTC m=+612.890347548" watchObservedRunningTime="2026-07-14 01:10:19.490270327 +0000 UTC m=+612.891581819"
Jul 14 01:10:19.507072 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.507023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" podStartSLOduration=1.5070017999999998 podStartE2EDuration="1.5070018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:19.504993091 +0000 UTC m=+612.906304582" watchObservedRunningTime="2026-07-14 01:10:19.5070018 +0000 UTC m=+612.908313292"
Jul 14 01:10:19.521113 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:19.521090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:10:19.524027 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:19.524003    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0afa39_3598_49aa_aacf_eb2c459ea59b.slice/crio-9b580e210ca29ec4bc5b8aaf6771601fceece5d90ec7cd7a30472fd661d54c76 WatchSource:0}: Error finding container 9b580e210ca29ec4bc5b8aaf6771601fceece5d90ec7cd7a30472fd661d54c76: Status 404 returned error can't find the container with id 9b580e210ca29ec4bc5b8aaf6771601fceece5d90ec7cd7a30472fd661d54c76
Jul 14 01:10:20.481693 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:20.481647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" event={"ID":"ef0afa39-3598-49aa-aacf-eb2c459ea59b","Type":"ContainerStarted","Data":"236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6"}
Jul 14 01:10:20.482171 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:20.481932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:20.482171 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:20.481956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" event={"ID":"ef0afa39-3598-49aa-aacf-eb2c459ea59b","Type":"ContainerStarted","Data":"9b580e210ca29ec4bc5b8aaf6771601fceece5d90ec7cd7a30472fd661d54c76"}
Jul 14 01:10:20.504829 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:20.504777    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" podStartSLOduration=1.504761581 podStartE2EDuration="1.504761581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:20.503702971 +0000 UTC m=+613.905014484" watchObservedRunningTime="2026-07-14 01:10:20.504761581 +0000 UTC m=+613.906073121"
Jul 14 01:10:30.483888 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:30.483799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:30.484405 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:30.484103    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t8g2x"
Jul 14 01:10:31.489319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.489286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:10:31.534780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.534737    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:31.534998 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.534973    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" podUID="a700b757-f8d7-489d-9373-4e6ce26482e0" containerName="manager" containerID="cri-o://e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064" gracePeriod=10
Jul 14 01:10:31.782720 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.782698    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:31.818226 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.818197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d95ds\" (UniqueName: \"kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds\") pod \"a700b757-f8d7-489d-9373-4e6ce26482e0\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") "
Jul 14 01:10:31.818378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.818257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume\") pod \"a700b757-f8d7-489d-9373-4e6ce26482e0\" (UID: \"a700b757-f8d7-489d-9373-4e6ce26482e0\") "
Jul 14 01:10:31.818652 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.818631    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a700b757-f8d7-489d-9373-4e6ce26482e0" (UID: "a700b757-f8d7-489d-9373-4e6ce26482e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:10:31.820462 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.820438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds" (OuterVolumeSpecName: "kube-api-access-d95ds") pod "a700b757-f8d7-489d-9373-4e6ce26482e0" (UID: "a700b757-f8d7-489d-9373-4e6ce26482e0"). InnerVolumeSpecName "kube-api-access-d95ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:10:31.919043 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.919001    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d95ds\" (UniqueName: \"kubernetes.io/projected/a700b757-f8d7-489d-9373-4e6ce26482e0-kube-api-access-d95ds\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:10:31.919043 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:31.919034    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a700b757-f8d7-489d-9373-4e6ce26482e0-extensions-socket-volume\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:10:32.540680 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.540647    2565 generic.go:356] "Generic (PLEG): container finished" podID="a700b757-f8d7-489d-9373-4e6ce26482e0" containerID="e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064" exitCode=0
Jul 14 01:10:32.540680 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.540685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" event={"ID":"a700b757-f8d7-489d-9373-4e6ce26482e0","Type":"ContainerDied","Data":"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"}
Jul 14 01:10:32.541168 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.540694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"
Jul 14 01:10:32.541168 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.540734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l" event={"ID":"a700b757-f8d7-489d-9373-4e6ce26482e0","Type":"ContainerDied","Data":"56df4aa50ac06d16940cd38db48252e2df77c5fe9b075e78ce1917bf5fe91271"}
Jul 14 01:10:32.541168 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.540757    2565 scope.go:117] "RemoveContainer" containerID="e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"
Jul 14 01:10:32.549982 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.549963    2565 scope.go:117] "RemoveContainer" containerID="e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"
Jul 14 01:10:32.550304 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:10:32.550283    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064\": container with ID starting with e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064 not found: ID does not exist" containerID="e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"
Jul 14 01:10:32.550364 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.550314    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064"} err="failed to get container status \"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064\": rpc error: code = NotFound desc = could not find container \"e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064\": container with ID starting with e47bc7f2373915ecdb14845a1e9f4f49c7913a1a9061aacbfe6465ccc3989064 not found: ID does not exist"
Jul 14 01:10:32.564548 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.564510    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:32.567173 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:32.567152    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hbp4l"]
Jul 14 01:10:33.170949 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:33.170917    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a700b757-f8d7-489d-9373-4e6ce26482e0" path="/var/lib/kubelet/pods/a700b757-f8d7-489d-9373-4e6ce26482e0/volumes"
Jul 14 01:10:47.908567 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.908533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"]
Jul 14 01:10:47.908932 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.908914    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a700b757-f8d7-489d-9373-4e6ce26482e0" containerName="manager"
Jul 14 01:10:47.908932 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.908926    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a700b757-f8d7-489d-9373-4e6ce26482e0" containerName="manager"
Jul 14 01:10:47.909014 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.909002    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a700b757-f8d7-489d-9373-4e6ce26482e0" containerName="manager"
Jul 14 01:10:47.914263 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.914243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.916959 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.916943    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 01:10:47.917188 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.917174    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xqdp8\""
Jul 14 01:10:47.924981 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.924954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"]
Jul 14 01:10:47.961823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.961953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf686d42-ad0c-4344-9487-388bff418267-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.961953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.961953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzzv\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-kube-api-access-kmzzv\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.961953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.962106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.962106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.961990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.962106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.962007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf686d42-ad0c-4344-9487-388bff418267-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:47.962106 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:47.962045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.062791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.062754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.062963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.062798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf686d42-ad0c-4344-9487-388bff418267-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.062963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.062915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.062963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.062959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzzv\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-kube-api-access-kmzzv\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf686d42-ad0c-4344-9487-388bff418267-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063529 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063581 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.063925 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.063906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf686d42-ad0c-4344-9487-388bff418267-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.065453 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.065421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf686d42-ad0c-4344-9487-388bff418267-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.065651 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.065635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf686d42-ad0c-4344-9487-388bff418267-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.078647 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.078617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzzv\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-kube-api-access-kmzzv\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.078812 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.078797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf686d42-ad0c-4344-9487-388bff418267-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-p6hms\" (UID: \"cf686d42-ad0c-4344-9487-388bff418267\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.226023 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.225945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:48.361835 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.361812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"]
Jul 14 01:10:48.364175 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:48.364152    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf686d42_ad0c_4344_9487_388bff418267.slice/crio-7b61c12f2b575953ecb534afe0cc6a6a923321c806815be9e05c6786fbf6909c WatchSource:0}: Error finding container 7b61c12f2b575953ecb534afe0cc6a6a923321c806815be9e05c6786fbf6909c: Status 404 returned error can't find the container with id 7b61c12f2b575953ecb534afe0cc6a6a923321c806815be9e05c6786fbf6909c
Jul 14 01:10:48.622781 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:48.622749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" event={"ID":"cf686d42-ad0c-4344-9487-388bff418267","Type":"ContainerStarted","Data":"7b61c12f2b575953ecb534afe0cc6a6a923321c806815be9e05c6786fbf6909c"}
Jul 14 01:10:51.131415 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:51.131377    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:10:51.131697 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:51.131449    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:10:51.131697 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:51.131476    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:10:51.643095 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:51.643060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" event={"ID":"cf686d42-ad0c-4344-9487-388bff418267","Type":"ContainerStarted","Data":"8f6ab753cd7139ee4681ca1fe1f18164fe438e3e6cfd997ad124611111a238b0"}
Jul 14 01:10:51.661343 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:51.661291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podStartSLOduration=1.896293381 podStartE2EDuration="4.661276174s" totalImagesPullingTime="2.764982793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:51.660449468 +0000 UTC m=+645.061760958" watchObservedRunningTime="2026-07-14 01:10:51.661276174 +0000 UTC m=+645.062587665"
Jul 14 01:10:52.226686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:52.226651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:52.231843 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:52.231809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:52.648038 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:52.648004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:52.649103 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:52.649088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:10:53.004781 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.004705    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:10:53.007462 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.007431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.009721 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.009699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9l8cc\""
Jul 14 01:10:53.009848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.009699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 01:10:53.016092 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.016069    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:10:53.047686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.047651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:10:53.108443 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.108408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50f81d06-3ead-426a-b368-9351a8d4e8cd-config-file\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.108834 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.108463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzk5l\" (UniqueName: \"kubernetes.io/projected/50f81d06-3ead-426a-b368-9351a8d4e8cd-kube-api-access-jzk5l\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.209638 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.209604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50f81d06-3ead-426a-b368-9351a8d4e8cd-config-file\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.209780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.209653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzk5l\" (UniqueName: \"kubernetes.io/projected/50f81d06-3ead-426a-b368-9351a8d4e8cd-kube-api-access-jzk5l\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.210291 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.210269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/50f81d06-3ead-426a-b368-9351a8d4e8cd-config-file\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.217714 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.217690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzk5l\" (UniqueName: \"kubernetes.io/projected/50f81d06-3ead-426a-b368-9351a8d4e8cd-kube-api-access-jzk5l\") pod \"limitador-limitador-54d6d988d5-hgnfl\" (UID: \"50f81d06-3ead-426a-b368-9351a8d4e8cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.318526 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.318491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:53.450786 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.450691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:10:53.453296 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:53.453268    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f81d06_3ead_426a_b368_9351a8d4e8cd.slice/crio-395d568e5bc3b547cf36ded909e491a173d57730e0debc214866717d69b82e90 WatchSource:0}: Error finding container 395d568e5bc3b547cf36ded909e491a173d57730e0debc214866717d69b82e90: Status 404 returned error can't find the container with id 395d568e5bc3b547cf36ded909e491a173d57730e0debc214866717d69b82e90
Jul 14 01:10:53.474181 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.474154    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:10:53.477317 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.477299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:10:53.479526 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.479508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2v97x\""
Jul 14 01:10:53.484433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.484410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:10:53.614010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.613917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cl8f\" (UniqueName: \"kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f\") pod \"authorino-58cd955675-7lh82\" (UID: \"b9819406-a956-4af0-a176-ffcd02dad772\") " pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:10:53.654099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.654065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl" event={"ID":"50f81d06-3ead-426a-b368-9351a8d4e8cd","Type":"ContainerStarted","Data":"395d568e5bc3b547cf36ded909e491a173d57730e0debc214866717d69b82e90"}
Jul 14 01:10:53.715073 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.715041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cl8f\" (UniqueName: \"kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f\") pod \"authorino-58cd955675-7lh82\" (UID: \"b9819406-a956-4af0-a176-ffcd02dad772\") " pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:10:53.723425 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.723390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cl8f\" (UniqueName: \"kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f\") pod \"authorino-58cd955675-7lh82\" (UID: \"b9819406-a956-4af0-a176-ffcd02dad772\") " pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:10:53.788426 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.788382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:10:53.929578 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:53.929549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:10:53.932303 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:10:53.932264    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9819406_a956_4af0_a176_ffcd02dad772.slice/crio-8160c45cd5c2be52288d5e7b2fd007d9764a5fe4ee6f993120f36013a9f9f705 WatchSource:0}: Error finding container 8160c45cd5c2be52288d5e7b2fd007d9764a5fe4ee6f993120f36013a9f9f705: Status 404 returned error can't find the container with id 8160c45cd5c2be52288d5e7b2fd007d9764a5fe4ee6f993120f36013a9f9f705
Jul 14 01:10:54.660950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:54.660909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7lh82" event={"ID":"b9819406-a956-4af0-a176-ffcd02dad772","Type":"ContainerStarted","Data":"8160c45cd5c2be52288d5e7b2fd007d9764a5fe4ee6f993120f36013a9f9f705"}
Jul 14 01:10:58.158290 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.158215    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:10:58.684621 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.684591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl" event={"ID":"50f81d06-3ead-426a-b368-9351a8d4e8cd","Type":"ContainerStarted","Data":"6031d29e96886f291781620b958c97359f842fa29b161e8ef3b557c83c9ac6bc"}
Jul 14 01:10:58.684773 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.684707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:10:58.686097 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.686075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7lh82" event={"ID":"b9819406-a956-4af0-a176-ffcd02dad772","Type":"ContainerStarted","Data":"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"}
Jul 14 01:10:58.702060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.702015    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl" podStartSLOduration=2.295851177 podStartE2EDuration="6.702002953s" totalImagesPullingTime="4.406151776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:58.699926199 +0000 UTC m=+652.101237690" watchObservedRunningTime="2026-07-14 01:10:58.702002953 +0000 UTC m=+652.103314470"
Jul 14 01:10:58.713645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:58.713605    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7lh82" podStartSLOduration=1.7859483200000001 podStartE2EDuration="5.713592215s" totalImagesPullingTime="3.927643895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:58.71250746 +0000 UTC m=+652.113818950" watchObservedRunningTime="2026-07-14 01:10:58.713592215 +0000 UTC m=+652.114903705"
Jul 14 01:10:59.690545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:59.690497    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7lh82" podUID="b9819406-a956-4af0-a176-ffcd02dad772" containerName="authorino" containerID="cri-o://7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e" gracePeriod=30
Jul 14 01:10:59.942423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:10:59.942364    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:11:00.079012 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.078981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cl8f\" (UniqueName: \"kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f\") pod \"b9819406-a956-4af0-a176-ffcd02dad772\" (UID: \"b9819406-a956-4af0-a176-ffcd02dad772\") "
Jul 14 01:11:00.081205 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.081178    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f" (OuterVolumeSpecName: "kube-api-access-4cl8f") pod "b9819406-a956-4af0-a176-ffcd02dad772" (UID: "b9819406-a956-4af0-a176-ffcd02dad772"). InnerVolumeSpecName "kube-api-access-4cl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:11:00.180234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.180203    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cl8f\" (UniqueName: \"kubernetes.io/projected/b9819406-a956-4af0-a176-ffcd02dad772-kube-api-access-4cl8f\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:11:00.696659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.696627    2565 generic.go:356] "Generic (PLEG): container finished" podID="b9819406-a956-4af0-a176-ffcd02dad772" containerID="7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e" exitCode=0
Jul 14 01:11:00.697167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.696665    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7lh82"
Jul 14 01:11:00.697167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.696712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7lh82" event={"ID":"b9819406-a956-4af0-a176-ffcd02dad772","Type":"ContainerDied","Data":"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"}
Jul 14 01:11:00.697167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.696748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7lh82" event={"ID":"b9819406-a956-4af0-a176-ffcd02dad772","Type":"ContainerDied","Data":"8160c45cd5c2be52288d5e7b2fd007d9764a5fe4ee6f993120f36013a9f9f705"}
Jul 14 01:11:00.697167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.696767    2565 scope.go:117] "RemoveContainer" containerID="7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"
Jul 14 01:11:00.705764 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.705750    2565 scope.go:117] "RemoveContainer" containerID="7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"
Jul 14 01:11:00.706005 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:11:00.705990    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e\": container with ID starting with 7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e not found: ID does not exist" containerID="7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"
Jul 14 01:11:00.706050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.706014    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e"} err="failed to get container status \"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e\": rpc error: code = NotFound desc = could not find container \"7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e\": container with ID starting with 7a98c1e9c8bd36590dcce6ff9b96a1b772d67e433486b9c8517799410b9fcf5e not found: ID does not exist"
Jul 14 01:11:00.716254 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.716225    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:11:00.718582 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:00.718560    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7lh82"]
Jul 14 01:11:01.176632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:01.176597    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9819406-a956-4af0-a176-ffcd02dad772" path="/var/lib/kubelet/pods/b9819406-a956-4af0-a176-ffcd02dad772/volumes"
Jul 14 01:11:09.691960 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:09.691929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"
Jul 14 01:11:27.811565 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.811531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5k4wj"]
Jul 14 01:11:27.811936 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.811928    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9819406-a956-4af0-a176-ffcd02dad772" containerName="authorino"
Jul 14 01:11:27.811978 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.811940    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9819406-a956-4af0-a176-ffcd02dad772" containerName="authorino"
Jul 14 01:11:27.812009 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.811999    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9819406-a956-4af0-a176-ffcd02dad772" containerName="authorino"
Jul 14 01:11:27.831713 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.831680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5k4wj"]
Jul 14 01:11:27.831905 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.831787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:27.834303 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.834269    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2v97x\""
Jul 14 01:11:27.917575 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.917538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkhs4\" (UniqueName: \"kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4\") pod \"authorino-5d4b67c446-5k4wj\" (UID: \"2c027bac-44be-4f10-9cf0-83f7aa2a88f0\") " pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:27.983904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:27.983873    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5k4wj"]
Jul 14 01:11:27.984174 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:11:27.984153    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lkhs4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-5k4wj" podUID="2c027bac-44be-4f10-9cf0-83f7aa2a88f0"
Jul 14 01:11:28.008618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.008588    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-hczhg"]
Jul 14 01:11:28.018092 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.018060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkhs4\" (UniqueName: \"kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4\") pod \"authorino-5d4b67c446-5k4wj\" (UID: \"2c027bac-44be-4f10-9cf0-83f7aa2a88f0\") " pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:28.024082 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.024044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-hczhg"]
Jul 14 01:11:28.024239 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.024157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.025973 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.025953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkhs4\" (UniqueName: \"kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4\") pod \"authorino-5d4b67c446-5k4wj\" (UID: \"2c027bac-44be-4f10-9cf0-83f7aa2a88f0\") " pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:28.026456 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.026434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 01:11:28.069282 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.069210    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hczhg"]
Jul 14 01:11:28.069483 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:11:28.069463    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-plvbg tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-plvbg tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-hczhg" podUID="2f74f2b4-bf9e-498e-8fcb-4984b1af922b"
Jul 14 01:11:28.097665 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.097634    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:11:28.104539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.104517    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.107782 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.107757    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:11:28.119460 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.119281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvbg\" (UniqueName: \"kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.119460 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.119419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.219878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.219849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58xfg\" (UniqueName: \"kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.219878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.219887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.220157 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.219938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.220157 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.220109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvbg\" (UniqueName: \"kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.222530 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.222507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.227942 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.227922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvbg\" (UniqueName: \"kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg\") pod \"authorino-76877994-hczhg\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") " pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.321053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.320976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58xfg\" (UniqueName: \"kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.321053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.321010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.323602 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.323573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.328797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.328774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58xfg\" (UniqueName: \"kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg\") pod \"authorino-846c857f6-6dmvf\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") " pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.414827 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.414792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:11:28.570566 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.570523    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:11:28.574758 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:11:28.574730    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod344267b2_d7fd_431f_8e27_62fb0ab9a7dc.slice/crio-a462649b05a4ea9c0c27dfad9739027707dc941204eae3aee05438499568dee0 WatchSource:0}: Error finding container a462649b05a4ea9c0c27dfad9739027707dc941204eae3aee05438499568dee0: Status 404 returned error can't find the container with id a462649b05a4ea9c0c27dfad9739027707dc941204eae3aee05438499568dee0
Jul 14 01:11:28.830340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.830249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.830340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.830265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846c857f6-6dmvf" event={"ID":"344267b2-d7fd-431f-8e27-62fb0ab9a7dc","Type":"ContainerStarted","Data":"a462649b05a4ea9c0c27dfad9739027707dc941204eae3aee05438499568dee0"}
Jul 14 01:11:28.830340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.830293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:28.865118 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.865081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:28.881099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.881075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:28.927085 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.927053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkhs4\" (UniqueName: \"kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4\") pod \"2c027bac-44be-4f10-9cf0-83f7aa2a88f0\" (UID: \"2c027bac-44be-4f10-9cf0-83f7aa2a88f0\") "
Jul 14 01:11:28.927256 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.927159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plvbg\" (UniqueName: \"kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg\") pod \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") "
Jul 14 01:11:28.927256 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.927199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert\") pod \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\" (UID: \"2f74f2b4-bf9e-498e-8fcb-4984b1af922b\") "
Jul 14 01:11:28.929271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.929239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2f74f2b4-bf9e-498e-8fcb-4984b1af922b" (UID: "2f74f2b4-bf9e-498e-8fcb-4984b1af922b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:11:28.929366 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.929272    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg" (OuterVolumeSpecName: "kube-api-access-plvbg") pod "2f74f2b4-bf9e-498e-8fcb-4984b1af922b" (UID: "2f74f2b4-bf9e-498e-8fcb-4984b1af922b"). InnerVolumeSpecName "kube-api-access-plvbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:11:28.929436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:28.929418    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4" (OuterVolumeSpecName: "kube-api-access-lkhs4") pod "2c027bac-44be-4f10-9cf0-83f7aa2a88f0" (UID: "2c027bac-44be-4f10-9cf0-83f7aa2a88f0"). InnerVolumeSpecName "kube-api-access-lkhs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:11:29.028109 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.028075    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkhs4\" (UniqueName: \"kubernetes.io/projected/2c027bac-44be-4f10-9cf0-83f7aa2a88f0-kube-api-access-lkhs4\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:11:29.028109 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.028107    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plvbg\" (UniqueName: \"kubernetes.io/projected/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-kube-api-access-plvbg\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:11:29.028328 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.028147    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2f74f2b4-bf9e-498e-8fcb-4984b1af922b-tls-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:11:29.834674 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.834644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-hczhg"
Jul 14 01:11:29.835162 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.834644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5k4wj"
Jul 14 01:11:29.862078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.862050    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5k4wj"]
Jul 14 01:11:29.867290 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.867266    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5k4wj"]
Jul 14 01:11:29.885667 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.885645    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-hczhg"]
Jul 14 01:11:29.888275 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:29.888254    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-hczhg"]
Jul 14 01:11:30.840462 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:30.840424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846c857f6-6dmvf" event={"ID":"344267b2-d7fd-431f-8e27-62fb0ab9a7dc","Type":"ContainerStarted","Data":"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"}
Jul 14 01:11:30.856627 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:30.856579    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-846c857f6-6dmvf" podStartSLOduration=1.5661771930000001 podStartE2EDuration="2.856565871s" totalImagesPullingTime="1.290388678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:11:30.85493533 +0000 UTC m=+684.256246868" watchObservedRunningTime="2026-07-14 01:11:30.856565871 +0000 UTC m=+684.257877362"
Jul 14 01:11:31.172115 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:31.172031    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c027bac-44be-4f10-9cf0-83f7aa2a88f0" path="/var/lib/kubelet/pods/2c027bac-44be-4f10-9cf0-83f7aa2a88f0/volumes"
Jul 14 01:11:31.172322 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:11:31.172309    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f74f2b4-bf9e-498e-8fcb-4984b1af922b" path="/var/lib/kubelet/pods/2f74f2b4-bf9e-498e-8fcb-4984b1af922b/volumes"
Jul 14 01:12:14.845149 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:14.845041    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:12:22.649468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:22.649384    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-p6hms container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 14 01:12:22.649468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:22.649439    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podUID="cf686d42-ad0c-4344-9487-388bff418267" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 14 01:12:23.084990 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.084955    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf686d42-ad0c-4344-9487-388bff418267" containerID="8f6ab753cd7139ee4681ca1fe1f18164fe438e3e6cfd997ad124611111a238b0" exitCode=0
Jul 14 01:12:23.085172 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.085024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" event={"ID":"cf686d42-ad0c-4344-9487-388bff418267","Type":"ContainerDied","Data":"8f6ab753cd7139ee4681ca1fe1f18164fe438e3e6cfd997ad124611111a238b0"}
Jul 14 01:12:23.085479 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.085464    2565 scope.go:117] "RemoveContainer" containerID="8f6ab753cd7139ee4681ca1fe1f18164fe438e3e6cfd997ad124611111a238b0"
Jul 14 01:12:23.086499 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.086465    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:12:23.086553 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.086538    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:12:23.086587 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:23.086569    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:12:24.092712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:24.092677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" event={"ID":"cf686d42-ad0c-4344-9487-388bff418267","Type":"ContainerStarted","Data":"a4ba2c9d8ffaea6fc34a608ef78387ac438c3054945c0389663abf625bf2a7f0"}
Jul 14 01:12:24.226108 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:24.226066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:12:24.226331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:24.226311    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-p6hms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 14 01:12:24.226404 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:24.226351    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podUID="cf686d42-ad0c-4344-9487-388bff418267" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 14 01:12:25.226428 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:25.226392    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-p6hms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 14 01:12:25.226879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:25.226452    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podUID="cf686d42-ad0c-4344-9487-388bff418267" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 14 01:12:26.226549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:26.226512    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-p6hms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 14 01:12:26.226910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:26.226590    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podUID="cf686d42-ad0c-4344-9487-388bff418267" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 14 01:12:27.227174 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:27.227106    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-p6hms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 14 01:12:27.227547 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:27.227193    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms" podUID="cf686d42-ad0c-4344-9487-388bff418267" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 14 01:12:28.230897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:28.230867    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:12:28.237205 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:28.232597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:12:28.237804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:28.237783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-p6hms"
Jul 14 01:12:38.347664 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:38.347630    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:12:45.841405 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:12:45.841371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:13:17.057950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:17.057901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:13:25.248567 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:25.248528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:13:30.655173 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.655071    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"]
Jul 14 01:13:30.658699 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.658676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.662093 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.662070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vmjgp\""
Jul 14 01:13:30.662258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.662094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 14 01:13:30.662258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.662072    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 01:13:30.662258 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.662185    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 01:13:30.667498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.667477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"]
Jul 14 01:13:30.704739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.704739 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcc0451c-db3b-4794-b652-47f3f91ebb56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.704937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.704937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.704937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcs9b\" (UniqueName: \"kubernetes.io/projected/dcc0451c-db3b-4794-b652-47f3f91ebb56-kube-api-access-xcs9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.704937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.704904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805316 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcs9b\" (UniqueName: \"kubernetes.io/projected/dcc0451c-db3b-4794-b652-47f3f91ebb56-kube-api-access-xcs9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcc0451c-db3b-4794-b652-47f3f91ebb56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805863 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805934 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.805972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.805947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.807875 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.807851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcc0451c-db3b-4794-b652-47f3f91ebb56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.808163 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.808145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcc0451c-db3b-4794-b652-47f3f91ebb56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.812903 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.812882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcs9b\" (UniqueName: \"kubernetes.io/projected/dcc0451c-db3b-4794-b652-47f3f91ebb56-kube-api-access-xcs9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dwl9q\" (UID: \"dcc0451c-db3b-4794-b652-47f3f91ebb56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:30.969333 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:30.969239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:31.107897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:31.107872    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"]
Jul 14 01:13:31.110652 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:13:31.110626    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc0451c_db3b_4794_b652_47f3f91ebb56.slice/crio-434ce57b6dd731364db7d747bdf78c8f6a5385c0269237a34a8c879493663896 WatchSource:0}: Error finding container 434ce57b6dd731364db7d747bdf78c8f6a5385c0269237a34a8c879493663896: Status 404 returned error can't find the container with id 434ce57b6dd731364db7d747bdf78c8f6a5385c0269237a34a8c879493663896
Jul 14 01:13:31.112346 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:31.112328    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 01:13:31.423698 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:31.423653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q" event={"ID":"dcc0451c-db3b-4794-b652-47f3f91ebb56","Type":"ContainerStarted","Data":"434ce57b6dd731364db7d747bdf78c8f6a5385c0269237a34a8c879493663896"}
Jul 14 01:13:32.430384 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:32.430290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q" event={"ID":"dcc0451c-db3b-4794-b652-47f3f91ebb56","Type":"ContainerStarted","Data":"becd75bd6c00b32b771b860286a952e0cc5765a6d8a4ceee16e63d01ef93aa6e"}
Jul 14 01:13:32.446954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:32.446903    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q" podStartSLOduration=1.425924546 podStartE2EDuration="2.446887129s" totalImagesPullingTime="1.020962583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:13:32.445482906 +0000 UTC m=+805.846794395" watchObservedRunningTime="2026-07-14 01:13:32.446887129 +0000 UTC m=+805.848198619"
Jul 14 01:13:32.953398 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:32.950835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:13:36.748601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.748568    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"]
Jul 14 01:13:36.752765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.752742    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.755392 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.755373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 14 01:13:36.761360 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.761338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"]
Jul 14 01:13:36.862010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.861977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.862191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.862025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.862191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.862044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20cf405c-396a-4e18-b1c8-366ff9c9688c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.862191 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.862105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-242d9\" (UniqueName: \"kubernetes.io/projected/20cf405c-396a-4e18-b1c8-366ff9c9688c-kube-api-access-242d9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.862301 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.862203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.862301 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.862238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963458 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20cf405c-396a-4e18-b1c8-366ff9c9688c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-242d9\" (UniqueName: \"kubernetes.io/projected/20cf405c-396a-4e18-b1c8-366ff9c9688c-kube-api-access-242d9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.963966 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.963907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.964023 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.964008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.965937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.965912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20cf405c-396a-4e18-b1c8-366ff9c9688c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.966083 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.966063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20cf405c-396a-4e18-b1c8-366ff9c9688c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:36.971312 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:36.971292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-242d9\" (UniqueName: \"kubernetes.io/projected/20cf405c-396a-4e18-b1c8-366ff9c9688c-kube-api-access-242d9\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x\" (UID: \"20cf405c-396a-4e18-b1c8-366ff9c9688c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:37.063698 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:37.063665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:37.202457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:37.202353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"]
Jul 14 01:13:37.205145 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:13:37.205102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20cf405c_396a_4e18_b1c8_366ff9c9688c.slice/crio-2515b55ceb840efd88d9e93a8879e405978fa7196102bfbed5d88b42f00683ec WatchSource:0}: Error finding container 2515b55ceb840efd88d9e93a8879e405978fa7196102bfbed5d88b42f00683ec: Status 404 returned error can't find the container with id 2515b55ceb840efd88d9e93a8879e405978fa7196102bfbed5d88b42f00683ec
Jul 14 01:13:37.454948 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:37.454909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x" event={"ID":"20cf405c-396a-4e18-b1c8-366ff9c9688c","Type":"ContainerStarted","Data":"3cb4dd7f6c5ba473e78363b854f4ec262d30292a881e06343e460ec91dd8829b"}
Jul 14 01:13:37.454948 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:37.454953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x" event={"ID":"20cf405c-396a-4e18-b1c8-366ff9c9688c","Type":"ContainerStarted","Data":"2515b55ceb840efd88d9e93a8879e405978fa7196102bfbed5d88b42f00683ec"}
Jul 14 01:13:37.476541 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:37.476478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x" podStartSLOduration=1.306708633 podStartE2EDuration="1.476461095s" totalImagesPullingTime="169.752462ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:13:37.474668383 +0000 UTC m=+810.875979875" watchObservedRunningTime="2026-07-14 01:13:37.476461095 +0000 UTC m=+810.877772586"
Jul 14 01:13:40.969498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:40.969450    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:40.969882 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:40.969537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:40.982051 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:40.982025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:41.485356 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:41.485326    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dwl9q"
Jul 14 01:13:44.240135 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:44.240083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:13:47.064626 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:47.064582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:47.065076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:47.064641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:47.076930 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:47.076906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:13:47.515816 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:13:47.515734    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x"
Jul 14 01:14:45.413723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.413680    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bd644cb6f-8qjfx"]
Jul 14 01:14:45.417170 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.417151    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.424057 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.423843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bd644cb6f-8qjfx"]
Jul 14 01:14:45.503201 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.503173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d04b72f5-e0b6-4082-a298-d55f1be49bda-tls-cert\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.503373 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.503208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flmw\" (UniqueName: \"kubernetes.io/projected/d04b72f5-e0b6-4082-a298-d55f1be49bda-kube-api-access-7flmw\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.603904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.603869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d04b72f5-e0b6-4082-a298-d55f1be49bda-tls-cert\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.604084 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.603923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flmw\" (UniqueName: \"kubernetes.io/projected/d04b72f5-e0b6-4082-a298-d55f1be49bda-kube-api-access-7flmw\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.606499 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.606476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d04b72f5-e0b6-4082-a298-d55f1be49bda-tls-cert\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.611304 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.611283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flmw\" (UniqueName: \"kubernetes.io/projected/d04b72f5-e0b6-4082-a298-d55f1be49bda-kube-api-access-7flmw\") pod \"authorino-6bd644cb6f-8qjfx\" (UID: \"d04b72f5-e0b6-4082-a298-d55f1be49bda\") " pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.726710 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.726679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bd644cb6f-8qjfx"
Jul 14 01:14:45.875826 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:45.875754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bd644cb6f-8qjfx"]
Jul 14 01:14:45.879620 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:14:45.879589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd04b72f5_e0b6_4082_a298_d55f1be49bda.slice/crio-ba852547d441fc6f5a76d840018f83f1303c134273bd5029d34379822baee483 WatchSource:0}: Error finding container ba852547d441fc6f5a76d840018f83f1303c134273bd5029d34379822baee483: Status 404 returned error can't find the container with id ba852547d441fc6f5a76d840018f83f1303c134273bd5029d34379822baee483
Jul 14 01:14:46.803685 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:46.803647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bd644cb6f-8qjfx" event={"ID":"d04b72f5-e0b6-4082-a298-d55f1be49bda","Type":"ContainerStarted","Data":"e5a562256945783ffa07292584fb83968110db36e964bad5d1b38a5bd6e8a09d"}
Jul 14 01:14:46.803685 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:46.803687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bd644cb6f-8qjfx" event={"ID":"d04b72f5-e0b6-4082-a298-d55f1be49bda","Type":"ContainerStarted","Data":"ba852547d441fc6f5a76d840018f83f1303c134273bd5029d34379822baee483"}
Jul 14 01:14:46.820790 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:46.820730    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bd644cb6f-8qjfx" podStartSLOduration=1.107417114 podStartE2EDuration="1.820707722s" totalImagesPullingTime="713.290608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:14:46.820096045 +0000 UTC m=+880.221407538" watchObservedRunningTime="2026-07-14 01:14:46.820707722 +0000 UTC m=+880.222019217"
Jul 14 01:14:46.848016 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:46.847923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:14:46.848188 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:46.848165    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-846c857f6-6dmvf" podUID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" containerName="authorino" containerID="cri-o://5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd" gracePeriod=30
Jul 14 01:14:47.117322 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.117285    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:14:47.220189 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.220140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58xfg\" (UniqueName: \"kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg\") pod \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") "
Jul 14 01:14:47.220378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.220241    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert\") pod \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\" (UID: \"344267b2-d7fd-431f-8e27-62fb0ab9a7dc\") "
Jul 14 01:14:47.222625 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.222590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg" (OuterVolumeSpecName: "kube-api-access-58xfg") pod "344267b2-d7fd-431f-8e27-62fb0ab9a7dc" (UID: "344267b2-d7fd-431f-8e27-62fb0ab9a7dc"). InnerVolumeSpecName "kube-api-access-58xfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:14:47.231819 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.231780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "344267b2-d7fd-431f-8e27-62fb0ab9a7dc" (UID: "344267b2-d7fd-431f-8e27-62fb0ab9a7dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:14:47.321821 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.321788    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58xfg\" (UniqueName: \"kubernetes.io/projected/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-kube-api-access-58xfg\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:14:47.321821 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.321821    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/344267b2-d7fd-431f-8e27-62fb0ab9a7dc-tls-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:14:47.810246 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.810208    2565 generic.go:356] "Generic (PLEG): container finished" podID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" containerID="5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd" exitCode=0
Jul 14 01:14:47.810632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.810256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-846c857f6-6dmvf"
Jul 14 01:14:47.810632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.810304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846c857f6-6dmvf" event={"ID":"344267b2-d7fd-431f-8e27-62fb0ab9a7dc","Type":"ContainerDied","Data":"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"}
Jul 14 01:14:47.810632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.810352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-846c857f6-6dmvf" event={"ID":"344267b2-d7fd-431f-8e27-62fb0ab9a7dc","Type":"ContainerDied","Data":"a462649b05a4ea9c0c27dfad9739027707dc941204eae3aee05438499568dee0"}
Jul 14 01:14:47.810632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.810377    2565 scope.go:117] "RemoveContainer" containerID="5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"
Jul 14 01:14:47.820251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.820231    2565 scope.go:117] "RemoveContainer" containerID="5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"
Jul 14 01:14:47.820559 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:14:47.820536    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd\": container with ID starting with 5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd not found: ID does not exist" containerID="5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"
Jul 14 01:14:47.820630 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.820571    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd"} err="failed to get container status \"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd\": rpc error: code = NotFound desc = could not find container \"5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd\": container with ID starting with 5df48ac5035b7e85cffb5a05618ac86f65acf05d2022b6678ce215c8ad6a43fd not found: ID does not exist"
Jul 14 01:14:47.832196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.832172    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:14:47.834064 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:47.834044    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-846c857f6-6dmvf"]
Jul 14 01:14:49.172218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:14:49.172189    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" path="/var/lib/kubelet/pods/344267b2-d7fd-431f-8e27-62fb0ab9a7dc/volumes"
Jul 14 01:15:07.398580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:07.398506    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:15:07.399324 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:07.399303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:15:07.405992 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:07.405976    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:15:07.406621 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:07.406602    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:15:18.548195 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:18.548161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:15:30.541516 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:30.541484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:15:40.150032 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:40.149995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:15:49.147812 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:49.147780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:15:59.853389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:15:59.853346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:16:25.552284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:16:25.552246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:16:38.151793 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:16:38.151750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:17:12.747274 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:17:12.747239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:17:22.853802 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:17:22.853766    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:17:33.935944 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:17:33.935909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:17:40.447854 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:17:40.447817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:17:51.841266 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:17:51.841226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:18:02.749092 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:18:02.748998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:18:15.151613 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:18:15.151579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:18:22.952182 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:18:22.952150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:18:49.652296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:18:49.652253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:19:00.543333 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:19:00.543291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:19:17.946008 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:19:17.945966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:19:31.545033 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:19:31.544948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:19:40.649290 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:19:40.649253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:19:52.351681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:19:52.351649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:20:02.760879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:02.760831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:20:07.432944 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:07.432905    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:20:07.435377 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:07.435355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:20:07.440491 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:07.440471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:20:07.442496 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:07.442477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:20:12.639471 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:12.639437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:20:22.745217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:22.745183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:20:32.042213 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:32.042162    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:20:58.069632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:58.069550    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:20:58.070110 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:20:58.069729    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" podUID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" containerName="manager" containerID="cri-o://236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6" gracePeriod=10
Jul 14 01:21:00.625304 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:21:00.625269    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0afa39_3598_49aa_aacf_eb2c459ea59b.slice/crio-236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6.scope\": RecentStats: unable to find data in memory cache]"
Jul 14 01:21:00.701218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.701184    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" containerID="236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6" exitCode=0
Jul 14 01:21:00.701373 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.701258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" event={"ID":"ef0afa39-3598-49aa-aacf-eb2c459ea59b","Type":"ContainerDied","Data":"236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6"}
Jul 14 01:21:00.832251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.832222    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:21:00.920285 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.920196    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume\") pod \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") "
Jul 14 01:21:00.920453 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.920289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlbdc\" (UniqueName: \"kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc\") pod \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\" (UID: \"ef0afa39-3598-49aa-aacf-eb2c459ea59b\") "
Jul 14 01:21:00.920599 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.920573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef0afa39-3598-49aa-aacf-eb2c459ea59b" (UID: "ef0afa39-3598-49aa-aacf-eb2c459ea59b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:21:00.922509 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:00.922484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc" (OuterVolumeSpecName: "kube-api-access-zlbdc") pod "ef0afa39-3598-49aa-aacf-eb2c459ea59b" (UID: "ef0afa39-3598-49aa-aacf-eb2c459ea59b"). InnerVolumeSpecName "kube-api-access-zlbdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:21:01.021759 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.021725    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0afa39-3598-49aa-aacf-eb2c459ea59b-extensions-socket-volume\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:21:01.021759 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.021756    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlbdc\" (UniqueName: \"kubernetes.io/projected/ef0afa39-3598-49aa-aacf-eb2c459ea59b-kube-api-access-zlbdc\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:21:01.707640 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.707609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"
Jul 14 01:21:01.708103 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.707605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267" event={"ID":"ef0afa39-3598-49aa-aacf-eb2c459ea59b","Type":"ContainerDied","Data":"9b580e210ca29ec4bc5b8aaf6771601fceece5d90ec7cd7a30472fd661d54c76"}
Jul 14 01:21:01.708103 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.707762    2565 scope.go:117] "RemoveContainer" containerID="236e1c6e565cc73481066342fb4cb939cc0a538f7ddbc2519313e1396158b1c6"
Jul 14 01:21:01.725937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.725915    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:21:01.730841 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:01.730820    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rn267"]
Jul 14 01:21:03.173702 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:03.173659    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" path="/var/lib/kubelet/pods/ef0afa39-3598-49aa-aacf-eb2c459ea59b/volumes"
Jul 14 01:21:59.457568 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.457529    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"]
Jul 14 01:21:59.458107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458028    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" containerName="manager"
Jul 14 01:21:59.458107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" containerName="manager"
Jul 14 01:21:59.458107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458082    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" containerName="authorino"
Jul 14 01:21:59.458107 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458089    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" containerName="authorino"
Jul 14 01:21:59.458319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458183    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0afa39-3598-49aa-aacf-eb2c459ea59b" containerName="manager"
Jul 14 01:21:59.458319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.458194    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="344267b2-d7fd-431f-8e27-62fb0ab9a7dc" containerName="authorino"
Jul 14 01:21:59.461208 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.461193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.463550 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.463531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrt4w\""
Jul 14 01:21:59.473341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.473321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"]
Jul 14 01:21:59.554402 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.554361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91de5a1-5517-423b-af8a-ef8a86103af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.554570 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.554410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz78c\" (UniqueName: \"kubernetes.io/projected/b91de5a1-5517-423b-af8a-ef8a86103af4-kube-api-access-nz78c\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.655471 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.655439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91de5a1-5517-423b-af8a-ef8a86103af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.655471 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.655477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz78c\" (UniqueName: \"kubernetes.io/projected/b91de5a1-5517-423b-af8a-ef8a86103af4-kube-api-access-nz78c\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.655824 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.655806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b91de5a1-5517-423b-af8a-ef8a86103af4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.663675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.663638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz78c\" (UniqueName: \"kubernetes.io/projected/b91de5a1-5517-423b-af8a-ef8a86103af4-kube-api-access-nz78c\") pod \"kuadrant-operator-controller-manager-86878c769f-gxf46\" (UID: \"b91de5a1-5517-423b-af8a-ef8a86103af4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.771956 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.771857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:21:59.911587 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.911554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"]
Jul 14 01:21:59.915601 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:21:59.915566    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91de5a1_5517_423b_af8a_ef8a86103af4.slice/crio-236f0cbde180d1b597dff1a048e775dfe5f76d1b0718580e2c0f8f99e5591b52 WatchSource:0}: Error finding container 236f0cbde180d1b597dff1a048e775dfe5f76d1b0718580e2c0f8f99e5591b52: Status 404 returned error can't find the container with id 236f0cbde180d1b597dff1a048e775dfe5f76d1b0718580e2c0f8f99e5591b52
Jul 14 01:21:59.985217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:21:59.985192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46" event={"ID":"b91de5a1-5517-423b-af8a-ef8a86103af4","Type":"ContainerStarted","Data":"236f0cbde180d1b597dff1a048e775dfe5f76d1b0718580e2c0f8f99e5591b52"}
Jul 14 01:22:00.991482 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:00.991450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46" event={"ID":"b91de5a1-5517-423b-af8a-ef8a86103af4","Type":"ContainerStarted","Data":"5c25c8647957cf94c458cad2c0dd8e5fd8aa5e6d274224f1b48d75a2f1172c1f"}
Jul 14 01:22:00.991912 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:00.991507    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:22:01.011041 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:01.010985    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46" podStartSLOduration=2.010961699 podStartE2EDuration="2.010961699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:22:01.00932273 +0000 UTC m=+1314.410634221" watchObservedRunningTime="2026-07-14 01:22:01.010961699 +0000 UTC m=+1314.412273191"
Jul 14 01:22:11.998205 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:11.998168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gxf46"
Jul 14 01:22:22.742046 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:22.742011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:22:33.074353 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:33.074312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:22:44.045304 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:44.045258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:22:55.153179 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:22:55.153142    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:04.847565 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:04.847531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:17.249566 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:17.249527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:26.143212 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:26.143179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:37.535699 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:37.535662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:48.051524 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:48.051488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:23:57.044245 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:23:57.044207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:24:08.338961 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:24:08.338923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:24:33.037860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:24:33.037826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:24:40.848244 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:24:40.848207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:24:51.241488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:24:51.241453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:01.269907 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:01.269877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:07.463622 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:07.463585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:25:07.466933 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:07.466910    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:25:07.480150 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:07.480105    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:25:07.483102 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:07.483080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:25:10.647420 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:10.647383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:22.748998 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:22.748962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:34.244988 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:34.244948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:43.938378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:43.938333    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:25:53.350920 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:25:53.350879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:03.358938 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:03.358904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:12.939322 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:12.939288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:26.346159 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:26.346113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:35.451862 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:35.451817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:46.551427 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:46.551392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:26:56.242575 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:26:56.242537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:27:09.850537 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:27:09.850452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:27:20.953075 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:27:20.953035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:27:33.346618 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:27:33.346572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:27:45.546889 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:27:45.546848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:27:55.543964 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:27:55.543926    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:28:08.244182 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:28:08.244146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:28:22.348853 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:28:22.348816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:28:31.950892 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:28:31.950857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:29:47.350777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:29:47.350741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:30:07.503815 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:30:07.503776    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:30:07.508559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:30:07.508522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:30:07.513942 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:30:07.513920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:30:07.517589 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:30:07.517569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:30:08.644029 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:30:08.643992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:31:08.749017 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:31:08.748985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:31:20.939294 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:31:20.939258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:32:21.648558 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:32:21.648522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:32:40.245189 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:32:40.245154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:33:53.245060 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:33:53.245021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:35:07.536790 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:07.536761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:35:07.541424 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:07.541400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:35:07.544536 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:07.544515    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:35:07.552804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:07.552786    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:35:29.051548 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:29.051517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:35:38.153812 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:38.153772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:35:49.865709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:35:49.865669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:36:09.348783 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:36:09.348695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:36:49.863518 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:36:49.863486    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:37:12.955559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.955525    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:37:12.958764 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.958741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:12.962682 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.962657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b02b4cdc\"/\"kube-root-ca.crt\""
Jul 14 01:37:12.962682 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.962676    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b02b4cdc\"/\"openshift-service-ca.crt\""
Jul 14 01:37:12.962873 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.962689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b02b4cdc\"/\"e2e-lifecycle-model-b02b4cdc-kserve-self-signed-certs\""
Jul 14 01:37:12.962873 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.962689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b02b4cdc\"/\"default-dockercfg-nbrhg\""
Jul 14 01:37:12.966853 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:12.966831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:37:13.006289 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.006446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.006446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.006446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8tn\" (UniqueName: \"kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.006446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.006446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.006424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8tn\" (UniqueName: \"kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.107712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.107691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.108034 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.108006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.108241 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.108050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.108384 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.108308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.110114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.110094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.110310 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.110291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.114803 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.114783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8tn\" (UniqueName: \"kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn\") pod \"e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") " pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.268945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.268849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:13.404198 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.404172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:37:13.407221 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:37:13.407176    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef962e8_5289_4dd6_b798_97217d1fc924.slice/crio-095b03859088a7625446e68af9080c8df3d56d106cc82b7a8e0d7dde631a36ce WatchSource:0}: Error finding container 095b03859088a7625446e68af9080c8df3d56d106cc82b7a8e0d7dde631a36ce: Status 404 returned error can't find the container with id 095b03859088a7625446e68af9080c8df3d56d106cc82b7a8e0d7dde631a36ce
Jul 14 01:37:13.541457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.541427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" event={"ID":"7ef962e8-5289-4dd6-b798-97217d1fc924","Type":"ContainerStarted","Data":"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"}
Jul 14 01:37:13.541457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.541465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" event={"ID":"7ef962e8-5289-4dd6-b798-97217d1fc924","Type":"ContainerStarted","Data":"095b03859088a7625446e68af9080c8df3d56d106cc82b7a8e0d7dde631a36ce"}
Jul 14 01:37:13.558200 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:13.558149    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" podStartSLOduration=1.5581154050000001 podStartE2EDuration="1.558115405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:37:13.555859445 +0000 UTC m=+2226.957170936" watchObservedRunningTime="2026-07-14 01:37:13.558115405 +0000 UTC m=+2226.959426896"
Jul 14 01:37:16.242665 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:16.242635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:37:23.269977 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:23.269937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:23.270499 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:23.269991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:23.282602 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:23.282579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:23.604879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:23.604843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:37:31.646234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:31.646150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:37:52.143045 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:52.143011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:37:57.905545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:37:57.905506    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:38:12.927919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:12.927851    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" podUID="7ef962e8-5289-4dd6-b798-97217d1fc924" containerName="main" containerID="cri-o://c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf" gracePeriod=45
Jul 14 01:38:13.172885 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.172859    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:38:13.265018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.264923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.264976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265007    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265076    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265099    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s8tn\" (UniqueName: \"kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265341 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm\") pod \"7ef962e8-5289-4dd6-b798-97217d1fc924\" (UID: \"7ef962e8-5289-4dd6-b798-97217d1fc924\") "
Jul 14 01:38:13.265488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home" (OuterVolumeSpecName: "home") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:38:13.265488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:38:13.265488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265365    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:38:13.265612 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265487    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.265612 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265504    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.265612 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.265520    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.267486 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.267459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm" (OuterVolumeSpecName: "dshm") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:38:13.267566 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.267543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:38:13.267566 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.267552    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn" (OuterVolumeSpecName: "kube-api-access-7s8tn") pod "7ef962e8-5289-4dd6-b798-97217d1fc924" (UID: "7ef962e8-5289-4dd6-b798-97217d1fc924"). InnerVolumeSpecName "kube-api-access-7s8tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:38:13.366919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.366884    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s8tn\" (UniqueName: \"kubernetes.io/projected/7ef962e8-5289-4dd6-b798-97217d1fc924-kube-api-access-7s8tn\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.366919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.366911    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ef962e8-5289-4dd6-b798-97217d1fc924-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.366919 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.366920    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ef962e8-5289-4dd6-b798-97217d1fc924-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:38:13.840309 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.840276    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ef962e8-5289-4dd6-b798-97217d1fc924" containerID="c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf" exitCode=0
Jul 14 01:38:13.840478 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.840323    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"
Jul 14 01:38:13.840478 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.840333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" event={"ID":"7ef962e8-5289-4dd6-b798-97217d1fc924","Type":"ContainerDied","Data":"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"}
Jul 14 01:38:13.840478 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.840367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w" event={"ID":"7ef962e8-5289-4dd6-b798-97217d1fc924","Type":"ContainerDied","Data":"095b03859088a7625446e68af9080c8df3d56d106cc82b7a8e0d7dde631a36ce"}
Jul 14 01:38:13.840478 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.840386    2565 scope.go:117] "RemoveContainer" containerID="c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"
Jul 14 01:38:13.849855 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.849835    2565 scope.go:117] "RemoveContainer" containerID="c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"
Jul 14 01:38:13.850134 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:38:13.850103    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf\": container with ID starting with c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf not found: ID does not exist" containerID="c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"
Jul 14 01:38:13.850208 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.850152    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf"} err="failed to get container status \"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf\": rpc error: code = NotFound desc = could not find container \"c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf\": container with ID starting with c6a6bf16016ecccd8ddb128ba0f954cdf5016672d3f3835f32cb0eda56c934bf not found: ID does not exist"
Jul 14 01:38:13.860404 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.860383    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:38:13.863996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:13.863977    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b02b4cdc/e2e-lifecycle-model-b02b4cdc-kserve-647588688c-tk94w"]
Jul 14 01:38:15.171259 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:38:15.171226    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef962e8-5289-4dd6-b798-97217d1fc924" path="/var/lib/kubelet/pods/7ef962e8-5289-4dd6-b798-97217d1fc924/volumes"
Jul 14 01:39:09.451965 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:39:09.451927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:39:22.148397 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:39:22.148361    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:40:06.894663 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.894629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:40:06.895716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.895688    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef962e8-5289-4dd6-b798-97217d1fc924" containerName="main"
Jul 14 01:40:06.895716 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.895715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef962e8-5289-4dd6-b798-97217d1fc924" containerName="main"
Jul 14 01:40:06.895925 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.895834    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef962e8-5289-4dd6-b798-97217d1fc924" containerName="main"
Jul 14 01:40:06.898899 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.898882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:06.901362 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.901341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0c7042-openshift-default-dockercfg-8cb8p\""
Jul 14 01:40:06.910219 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:06.910191    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:40:07.012623 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.012587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.012927 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.012883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c8ck\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.012995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013209 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013209 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013209 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.013378 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.013268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.113954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.113915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.113954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.113958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.113983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8ck\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114580 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.114978 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.114955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.115247 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.115225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.116591 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.116572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.116787 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.116770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.121752 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.121730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c8ck\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.121752 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.121749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token\") pod \"e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") " pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.214687 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.214606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0c7042-openshift-default-dockercfg-8cb8p\""
Jul 14 01:40:07.223323 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.223281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:07.369432 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.369408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:40:07.372043 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:40:07.372009    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03eadde7_678d_4ee9_9fe7_796ea7d3df77.slice/crio-f881168aa138c4e731794c6e931c6fb73c85b6c1755e25f7a2b3034f2fa6da3c WatchSource:0}: Error finding container f881168aa138c4e731794c6e931c6fb73c85b6c1755e25f7a2b3034f2fa6da3c: Status 404 returned error can't find the container with id f881168aa138c4e731794c6e931c6fb73c85b6c1755e25f7a2b3034f2fa6da3c
Jul 14 01:40:07.374244 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.374213    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:07.374331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.374277    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:07.374331 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.374307    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:07.406933 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.406891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerStarted","Data":"f881168aa138c4e731794c6e931c6fb73c85b6c1755e25f7a2b3034f2fa6da3c"}
Jul 14 01:40:07.574848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.574822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:40:07.582592 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.582548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:40:07.582783 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.582766    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:40:07.590828 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:07.590809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:40:08.413261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:08.413227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerStarted","Data":"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"}
Jul 14 01:40:08.433865 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:08.433820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podStartSLOduration=2.43379993 podStartE2EDuration="2.43379993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:40:08.432186338 +0000 UTC m=+2401.833497827" watchObservedRunningTime="2026-07-14 01:40:08.43379993 +0000 UTC m=+2401.835111421"
Jul 14 01:40:09.223493 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:09.223458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:09.228903 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:09.228878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:09.418080 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:09.418054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:09.419076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:09.419056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:09.746719 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:09.746669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:40:22.154732 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:22.154688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:40:24.419640 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.419610    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 14 01:40:24.419972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.419670    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 14 01:40:24.492757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.492721    2565 generic.go:356] "Generic (PLEG): container finished" podID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerID="c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22" exitCode=0
Jul 14 01:40:24.492945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.492770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerDied","Data":"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"}
Jul 14 01:40:24.493243 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.493228    2565 scope.go:117] "RemoveContainer" containerID="c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"
Jul 14 01:40:24.494338 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.494309    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:24.494466 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.494379    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:24.494466 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:24.494436    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:40:25.502858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:25.502815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerStarted","Data":"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"}
Jul 14 01:40:26.224178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:26.224134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:26.224496 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:26.224474    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 14 01:40:26.224545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:26.224527    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 14 01:40:27.224074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:27.224034    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 14 01:40:27.224455 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:27.224090    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 14 01:40:28.224711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:28.224674    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 14 01:40:28.225207 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:28.224736    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 14 01:40:29.224024 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:29.223988    2565 patch_prober.go:28] interesting pod/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 14 01:40:29.224239 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:29.224041    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 14 01:40:30.227755 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.227722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:30.228166 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.227985    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:30.228706 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.228689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:40:30.646016 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.645985    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:40:30.650382 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.650360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.652892 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.652870    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8ddee0\"/\"default-dockercfg-nc4xj\""
Jul 14 01:40:30.653026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.652895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8ddee0\"/\"kube-root-ca.crt\""
Jul 14 01:40:30.653026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.652905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8ddee0\"/\"test-model-8ddee0-kserve-self-signed-certs\""
Jul 14 01:40:30.653026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.652948    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8ddee0\"/\"openshift-service-ca.crt\""
Jul 14 01:40:30.659737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.659718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:40:30.846045 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.846234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.846234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.846234 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.846345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.846345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.846268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcp8t\" (UniqueName: \"kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.946978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947061 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcp8t\" (UniqueName: \"kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947365 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947365 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947365 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.947615 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.947560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.949476 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.949445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.949713 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.949693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.954560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.954537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcp8t\" (UniqueName: \"kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t\") pod \"test-model-8ddee0-kserve-8ccb87677-bdn2j\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") " pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:30.960268 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:30.960248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:31.106945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:31.106922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:40:31.109178 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:40:31.109142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod861a759a_46ad_4d9a_aec5_74a0dc500f74.slice/crio-5e65b42c74df8209a70207ba71ff5a3f532c4d5594d917970e1574bfac2037a4 WatchSource:0}: Error finding container 5e65b42c74df8209a70207ba71ff5a3f532c4d5594d917970e1574bfac2037a4: Status 404 returned error can't find the container with id 5e65b42c74df8209a70207ba71ff5a3f532c4d5594d917970e1574bfac2037a4
Jul 14 01:40:31.541596 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:31.541562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" event={"ID":"861a759a-46ad-4d9a-aec5-74a0dc500f74","Type":"ContainerStarted","Data":"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"}
Jul 14 01:40:31.541991 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:31.541605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" event={"ID":"861a759a-46ad-4d9a-aec5-74a0dc500f74","Type":"ContainerStarted","Data":"5e65b42c74df8209a70207ba71ff5a3f532c4d5594d917970e1574bfac2037a4"}
Jul 14 01:40:31.557713 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:31.557659    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" podStartSLOduration=1.5576427590000002 podStartE2EDuration="1.557642759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:40:31.557003568 +0000 UTC m=+2424.958315060" watchObservedRunningTime="2026-07-14 01:40:31.557642759 +0000 UTC m=+2424.958954261"
Jul 14 01:40:35.149147 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:35.149094    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:40:40.962909 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:40.962868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:40.964049 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:40.964025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:40.980172 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:40.980141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:41.606634 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:41.606601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:40:47.752145 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:47.748205    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:40:58.152544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.152503    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:40:58.156567 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.156548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.159363 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.159336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0c7042\"/\"kube-root-ca.crt\""
Jul 14 01:40:58.159363 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.159336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0c7042\"/\"openshift-service-ca.crt\""
Jul 14 01:40:58.160345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.160327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0c7042\"/\"test-model-0c7042-kserve-self-signed-certs\""
Jul 14 01:40:58.160345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.160339    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0c7042\"/\"default-dockercfg-nsrlw\""
Jul 14 01:40:58.165051 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.165028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:40:58.309225 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.309225 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.309436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.309436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.309436 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.309541 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.309473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcmnb\" (UniqueName: \"kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410574 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410574 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410574 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410574 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcmnb\" (UniqueName: \"kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410968 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.410968 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.411076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.410991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.411076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.411051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.411171 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.411154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.413013 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.412991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.413215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.413198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.418971 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.418949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcmnb\" (UniqueName: \"kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb\") pod \"test-model-0c7042-kserve-5ddfb4db5c-69f4c\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") " pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.467368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.467337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:40:58.605362 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.605331    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:40:58.608865 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:40:58.608837    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c5e262_42a6_4c78_8d16_db5be3718ceb.slice/crio-a662982aca275765fa32b0c41f6a29de1b3ab38464260645add436a8c80c0503 WatchSource:0}: Error finding container a662982aca275765fa32b0c41f6a29de1b3ab38464260645add436a8c80c0503: Status 404 returned error can't find the container with id a662982aca275765fa32b0c41f6a29de1b3ab38464260645add436a8c80c0503
Jul 14 01:40:58.679788 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.679755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" event={"ID":"b9c5e262-42a6-4c78-8d16-db5be3718ceb","Type":"ContainerStarted","Data":"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"}
Jul 14 01:40:58.679912 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.679806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" event={"ID":"b9c5e262-42a6-4c78-8d16-db5be3718ceb","Type":"ContainerStarted","Data":"a662982aca275765fa32b0c41f6a29de1b3ab38464260645add436a8c80c0503"}
Jul 14 01:40:58.698208 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:40:58.698152    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" podStartSLOduration=0.698114872 podStartE2EDuration="698.114872ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:40:58.697415915 +0000 UTC m=+2452.098727406" watchObservedRunningTime="2026-07-14 01:40:58.698114872 +0000 UTC m=+2452.099426364"
Jul 14 01:41:04.159376 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:04.159338    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:41:08.467655 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:08.467616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:08.468054 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:08.467669    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:08.480072 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:08.480048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:08.743043 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:08.742958    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:17.845937 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:17.845899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:41:28.532849 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:28.532810    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:41:29.484914 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:29.484876    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:41:32.946412 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:32.946369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:41:43.553798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.553748    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" podUID="861a759a-46ad-4d9a-aec5-74a0dc500f74" containerName="main" containerID="cri-o://a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819" gracePeriod=45
Jul 14 01:41:43.805483 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.805419    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:41:43.913290 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.913257    2565 generic.go:356] "Generic (PLEG): container finished" podID="861a759a-46ad-4d9a-aec5-74a0dc500f74" containerID="a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819" exitCode=0
Jul 14 01:41:43.913449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.913302    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"
Jul 14 01:41:43.913449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.913320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" event={"ID":"861a759a-46ad-4d9a-aec5-74a0dc500f74","Type":"ContainerDied","Data":"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"}
Jul 14 01:41:43.913449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.913350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j" event={"ID":"861a759a-46ad-4d9a-aec5-74a0dc500f74","Type":"ContainerDied","Data":"5e65b42c74df8209a70207ba71ff5a3f532c4d5594d917970e1574bfac2037a4"}
Jul 14 01:41:43.913449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.913366    2565 scope.go:117] "RemoveContainer" containerID="a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"
Jul 14 01:41:43.922018 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.921994    2565 scope.go:117] "RemoveContainer" containerID="a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"
Jul 14 01:41:43.922307 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:41:43.922290    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819\": container with ID starting with a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819 not found: ID does not exist" containerID="a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"
Jul 14 01:41:43.922366 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.922317    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819"} err="failed to get container status \"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819\": rpc error: code = NotFound desc = could not find container \"a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819\": container with ID starting with a27ef896142fe9f8d6dbca56bc8e35083487d2039dbc85090f0ad09ee02a1819 not found: ID does not exist"
Jul 14 01:41:43.934628 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934719 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934719 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcp8t\" (UniqueName: \"kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934719 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934825 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934733    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934825 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home\") pod \"861a759a-46ad-4d9a-aec5-74a0dc500f74\" (UID: \"861a759a-46ad-4d9a-aec5-74a0dc500f74\") "
Jul 14 01:41:43.934974 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.934948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache" (OuterVolumeSpecName: "model-cache") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:43.935093 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.935073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:43.935176 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.935137    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home" (OuterVolumeSpecName: "home") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:43.935176 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.935164    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:43.936950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.936931    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:41:43.937037 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.936929    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm" (OuterVolumeSpecName: "dshm") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:43.937087 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:43.937043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t" (OuterVolumeSpecName: "kube-api-access-xcp8t") pod "861a759a-46ad-4d9a-aec5-74a0dc500f74" (UID: "861a759a-46ad-4d9a-aec5-74a0dc500f74"). InnerVolumeSpecName "kube-api-access-xcp8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:41:44.036325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.036295    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.036325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.036318    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcp8t\" (UniqueName: \"kubernetes.io/projected/861a759a-46ad-4d9a-aec5-74a0dc500f74-kube-api-access-xcp8t\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.036325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.036328    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.036325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.036337    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/861a759a-46ad-4d9a-aec5-74a0dc500f74-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.036581 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.036345    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/861a759a-46ad-4d9a-aec5-74a0dc500f74-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.234448 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.234420    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:41:44.237197 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.237173    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8ddee0/test-model-8ddee0-kserve-8ccb87677-bdn2j"]
Jul 14 01:41:44.507616 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.507512    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" podUID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" containerName="main" containerID="cri-o://37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b" gracePeriod=45
Jul 14 01:41:44.770861 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.770805    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:44.921271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.921237    2565 generic.go:356] "Generic (PLEG): container finished" podID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" containerID="37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b" exitCode=0
Jul 14 01:41:44.921444 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.921277    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"
Jul 14 01:41:44.921444 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.921284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" event={"ID":"b9c5e262-42a6-4c78-8d16-db5be3718ceb","Type":"ContainerDied","Data":"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"}
Jul 14 01:41:44.921444 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.921320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c" event={"ID":"b9c5e262-42a6-4c78-8d16-db5be3718ceb","Type":"ContainerDied","Data":"a662982aca275765fa32b0c41f6a29de1b3ab38464260645add436a8c80c0503"}
Jul 14 01:41:44.921444 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.921341    2565 scope.go:117] "RemoveContainer" containerID="37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"
Jul 14 01:41:44.929995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.929978    2565 scope.go:117] "RemoveContainer" containerID="37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"
Jul 14 01:41:44.930268 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:41:44.930250    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b\": container with ID starting with 37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b not found: ID does not exist" containerID="37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"
Jul 14 01:41:44.930319 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.930278    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b"} err="failed to get container status \"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b\": rpc error: code = NotFound desc = could not find container \"37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b\": container with ID starting with 37471cdaef913e66a9139216a28823ef52725eb54a04c7a34410ac71be4adc3b not found: ID does not exist"
Jul 14 01:41:44.944710 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944793 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944837 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944806    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944837 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944902 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcmnb\" (UniqueName: \"kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944946 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm\") pod \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\" (UID: \"b9c5e262-42a6-4c78-8d16-db5be3718ceb\") "
Jul 14 01:41:44.944998 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.944977    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:44.945114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.945096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home" (OuterVolumeSpecName: "home") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:44.945206 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.945113    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:44.945282 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.945266    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.945325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.945285    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.945325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.945294    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:44.947102 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.947083    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm" (OuterVolumeSpecName: "dshm") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:41:44.947180 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.947098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb" (OuterVolumeSpecName: "kube-api-access-dcmnb") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "kube-api-access-dcmnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:41:44.947220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:44.947187    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9c5e262-42a6-4c78-8d16-db5be3718ceb" (UID: "b9c5e262-42a6-4c78-8d16-db5be3718ceb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:41:45.045939 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.045915    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcmnb\" (UniqueName: \"kubernetes.io/projected/b9c5e262-42a6-4c78-8d16-db5be3718ceb-kube-api-access-dcmnb\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:45.045939 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.045940    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c5e262-42a6-4c78-8d16-db5be3718ceb-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:45.046089 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.045952    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c5e262-42a6-4c78-8d16-db5be3718ceb-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:41:45.170901 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.170875    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="861a759a-46ad-4d9a-aec5-74a0dc500f74" path="/var/lib/kubelet/pods/861a759a-46ad-4d9a-aec5-74a0dc500f74/volumes"
Jul 14 01:41:45.235324 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.235299    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:41:45.238899 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:45.238871    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0c7042/test-model-0c7042-kserve-5ddfb4db5c-69f4c"]
Jul 14 01:41:47.171313 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:47.171282    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" path="/var/lib/kubelet/pods/b9c5e262-42a6-4c78-8d16-db5be3718ceb/volumes"
Jul 14 01:41:50.250270 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:41:50.250236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:42:09.147777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:09.147743    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:42:21.468244 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:21.468212    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:42:21.468838 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:21.468442    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy" containerID="cri-o://f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857" gracePeriod=30
Jul 14 01:42:26.738482 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.738420    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:42:26.849632 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849798 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c8ck\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849914    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.849995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849959    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:42:26.850317 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.849978    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data\") pod \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\" (UID: \"03eadde7-678d-4ee9-9fe7-796ea7d3df77\") "
Jul 14 01:42:26.850317 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:42:26.850317 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:42:26.850549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850387    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-credential-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.850549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850409    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istiod-ca-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.850549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850424    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.850549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:42:26.850949 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.850922    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data" (OuterVolumeSpecName: "istio-data") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:42:26.851963 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.851939    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:42:26.852078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.852040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 01:42:26.852223 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.852202    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck" (OuterVolumeSpecName: "kube-api-access-4c8ck") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "kube-api-access-4c8ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:42:26.852401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.852386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token" (OuterVolumeSpecName: "istio-token") pod "03eadde7-678d-4ee9-9fe7-796ea7d3df77" (UID: "03eadde7-678d-4ee9-9fe7-796ea7d3df77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:42:26.951791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951760    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-token\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.951791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951791    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-workload-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.951979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951802    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-data\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.951979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951811    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-envoy\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.951979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951818    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03eadde7-678d-4ee9-9fe7-796ea7d3df77-istio-podinfo\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:26.951979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:26.951826    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c8ck\" (UniqueName: \"kubernetes.io/projected/03eadde7-678d-4ee9-9fe7-796ea7d3df77-kube-api-access-4c8ck\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:42:27.127084 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.127050    2565 generic.go:356] "Generic (PLEG): container finished" podID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerID="f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857" exitCode=0
Jul 14 01:42:27.127297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.127093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerDied","Data":"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"}
Jul 14 01:42:27.127297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.127105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"
Jul 14 01:42:27.127297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.127161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4" event={"ID":"03eadde7-678d-4ee9-9fe7-796ea7d3df77","Type":"ContainerDied","Data":"f881168aa138c4e731794c6e931c6fb73c85b6c1755e25f7a2b3034f2fa6da3c"}
Jul 14 01:42:27.127297 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.127182    2565 scope.go:117] "RemoveContainer" containerID="f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"
Jul 14 01:42:27.136627 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.136568    2565 scope.go:117] "RemoveContainer" containerID="c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"
Jul 14 01:42:27.144377 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.144360    2565 scope.go:117] "RemoveContainer" containerID="f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"
Jul 14 01:42:27.144605 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:42:27.144588    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857\": container with ID starting with f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857 not found: ID does not exist" containerID="f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"
Jul 14 01:42:27.144651 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.144613    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857"} err="failed to get container status \"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857\": rpc error: code = NotFound desc = could not find container \"f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857\": container with ID starting with f56cdb8cebc8d629ff47afeb54182495e1295a48bd232bdde4abe51ddd5c3857 not found: ID does not exist"
Jul 14 01:42:27.144651 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.144628    2565 scope.go:117] "RemoveContainer" containerID="c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"
Jul 14 01:42:27.144839 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:42:27.144821    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22\": container with ID starting with c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22 not found: ID does not exist" containerID="c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"
Jul 14 01:42:27.144886 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.144845    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22"} err="failed to get container status \"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22\": rpc error: code = NotFound desc = could not find container \"c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22\": container with ID starting with c1ea8c426f8bc8636fc4f5a158b2baccb11b889acf25cb99d76bcee17ab0de22 not found: ID does not exist"
Jul 14 01:42:27.148309 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.148289    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:42:27.151883 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.151862    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0c7042-openshift-default-57b7c4868c-jtff4"]
Jul 14 01:42:27.170876 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:27.170856    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" path="/var/lib/kubelet/pods/03eadde7-678d-4ee9-9fe7-796ea7d3df77/volumes"
Jul 14 01:42:30.343506 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.343463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:42:30.831312 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831273    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:42:30.831691 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831678    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861a759a-46ad-4d9a-aec5-74a0dc500f74" containerName="main"
Jul 14 01:42:30.831740 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831693    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="861a759a-46ad-4d9a-aec5-74a0dc500f74" containerName="main"
Jul 14 01:42:30.831740 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831740 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831719    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831740 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831726    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" containerName="main"
Jul 14 01:42:30.831740 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831731    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" containerName="main"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831747    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831755    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831809    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c5e262-42a6-4c78-8d16-db5be3718ceb" containerName="main"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831825    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03eadde7-678d-4ee9-9fe7-796ea7d3df77" containerName="istio-proxy"
Jul 14 01:42:30.831893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.831833    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="861a759a-46ad-4d9a-aec5-74a0dc500f74" containerName="main"
Jul 14 01:42:30.836429 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.836409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.838936 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.838918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7b8e5a-openshift-default-dockercfg-c57n9\""
Jul 14 01:42:30.846859 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.846839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:42:30.987578 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987761 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987997 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdbzv\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:30.987997 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:30.987847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088559 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbzv\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.088972 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.088943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.089220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.089018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.089220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.089106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.089298 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.089227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.089426 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.089406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.091069 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.091037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.091205 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.091185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.097008 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.096981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbzv\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.097248 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.097227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token\") pod \"e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") " pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.147954 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.147927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:31.294786 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.294759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:42:31.298287 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:42:31.298256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6d7083_f473_48b5_b71d_4356912202a1.slice/crio-123a2dfac69e0063119e13db558a5a5f0964770f357a83b11636493c3e1d1905 WatchSource:0}: Error finding container 123a2dfac69e0063119e13db558a5a5f0964770f357a83b11636493c3e1d1905: Status 404 returned error can't find the container with id 123a2dfac69e0063119e13db558a5a5f0964770f357a83b11636493c3e1d1905
Jul 14 01:42:31.300468 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.300433    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:31.300552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.300504    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:31.300552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:31.300540    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:32.154803 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:32.154769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerStarted","Data":"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"}
Jul 14 01:42:32.155200 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:32.154833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerStarted","Data":"123a2dfac69e0063119e13db558a5a5f0964770f357a83b11636493c3e1d1905"}
Jul 14 01:42:32.173792 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:32.173742    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podStartSLOduration=2.173726742 podStartE2EDuration="2.173726742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:42:32.171814978 +0000 UTC m=+2545.573126469" watchObservedRunningTime="2026-07-14 01:42:32.173726742 +0000 UTC m=+2545.575038232"
Jul 14 01:42:33.148652 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:33.148617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:33.153545 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:33.153515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:33.160020 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:33.159997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:33.160760 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:33.160742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:42.641648 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:42.641610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:42:49.202327 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:49.202287    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 14 01:42:49.202709 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:49.202387    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 14 01:42:51.255979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.255943    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce6d7083-f473-48b5-b71d-4356912202a1" containerID="4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114" exitCode=0
Jul 14 01:42:51.256433 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.256020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerDied","Data":"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"}
Jul 14 01:42:51.256478 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.256462    2565 scope.go:117] "RemoveContainer" containerID="4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"
Jul 14 01:42:51.257485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.257461    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:51.257541 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.257527    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:51.257578 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:51.257558    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:42:52.263401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:52.263371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerStarted","Data":"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"}
Jul 14 01:42:53.148554 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:53.148517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:53.148782 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:53.148760    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 14 01:42:53.148840 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:53.148818    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 14 01:42:54.148502 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:54.148467    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 14 01:42:54.148872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:54.148537    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 14 01:42:55.148579 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:55.148541    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 14 01:42:55.148964 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:55.148611    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 14 01:42:56.148681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:56.148641    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 14 01:42:56.149178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:56.148704    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 14 01:42:57.152452 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:57.152421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:57.152894 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:57.152689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:42:57.153429 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:42:57.153412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:43:01.444393 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:01.444356    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:43:26.053728 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:26.053694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:43:38.525193 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:38.525155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:43:38.525640 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:38.525421    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" containerID="cri-o://fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9" gracePeriod=30
Jul 14 01:43:42.155099 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:42.155057    2565 patch_prober.go:28] interesting pod/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 01:43:42.155501 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:42.155116    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 01:43:43.782607 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.782581    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:43:43.797979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.797898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.797979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.797955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.797986    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdbzv\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.798229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy\") pod \"ce6d7083-f473-48b5-b71d-4356912202a1\" (UID: \"ce6d7083-f473-48b5-b71d-4356912202a1\") "
Jul 14 01:43:43.799271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:43:43.799423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.798785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:43:43.799514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.799234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:43:43.799597 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.799340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:43:43.799673 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.799546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:43:43.801037 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.801003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:43:43.801268 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.801242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:43:43.801691 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.801669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 01:43:43.801975 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.801958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv" (OuterVolumeSpecName: "kube-api-access-xdbzv") pod "ce6d7083-f473-48b5-b71d-4356912202a1" (UID: "ce6d7083-f473-48b5-b71d-4356912202a1"). InnerVolumeSpecName "kube-api-access-xdbzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:43:43.899867 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899835    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce6d7083-f473-48b5-b71d-4356912202a1-istiod-ca-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.899867 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899863    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.899867 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899871    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce6d7083-f473-48b5-b71d-4356912202a1-istio-podinfo\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899880    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdbzv\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-kube-api-access-xdbzv\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899890    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-credential-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899898    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-envoy\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899906    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-workload-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899913    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce6d7083-f473-48b5-b71d-4356912202a1-istio-token\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:43.900220 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:43.899921    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6d7083-f473-48b5-b71d-4356912202a1-istio-data\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:43:44.524369 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.524336    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce6d7083-f473-48b5-b71d-4356912202a1" containerID="fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9" exitCode=0
Jul 14 01:43:44.524539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.524406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerDied","Data":"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"}
Jul 14 01:43:44.524539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.524422    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"
Jul 14 01:43:44.524539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.524449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch" event={"ID":"ce6d7083-f473-48b5-b71d-4356912202a1","Type":"ContainerDied","Data":"123a2dfac69e0063119e13db558a5a5f0964770f357a83b11636493c3e1d1905"}
Jul 14 01:43:44.524539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.524471    2565 scope.go:117] "RemoveContainer" containerID="fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"
Jul 14 01:43:44.534645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.534626    2565 scope.go:117] "RemoveContainer" containerID="4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"
Jul 14 01:43:44.543277 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.543258    2565 scope.go:117] "RemoveContainer" containerID="fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"
Jul 14 01:43:44.543557 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:43:44.543539    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9\": container with ID starting with fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9 not found: ID does not exist" containerID="fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"
Jul 14 01:43:44.543611 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.543567    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9"} err="failed to get container status \"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9\": rpc error: code = NotFound desc = could not find container \"fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9\": container with ID starting with fd9cc5a5027e61176d7dfe00ffaf99dcb2a6adf9db6c8dfaed8ac596acd33bb9 not found: ID does not exist"
Jul 14 01:43:44.543611 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.543586    2565 scope.go:117] "RemoveContainer" containerID="4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"
Jul 14 01:43:44.543831 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:43:44.543813    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114\": container with ID starting with 4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114 not found: ID does not exist" containerID="4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"
Jul 14 01:43:44.543887 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.543838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114"} err="failed to get container status \"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114\": rpc error: code = NotFound desc = could not find container \"4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114\": container with ID starting with 4d0a31b56400c584a4d018037eef548f03e3af46bff818659965665a0dfed114 not found: ID does not exist"
Jul 14 01:43:44.546903 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.546880    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:43:44.550697 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:44.550677    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7b8e5a-openshift-default-9698cf9d5-vhnch"]
Jul 14 01:43:45.170767 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:45.170732    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" path="/var/lib/kubelet/pods/ce6d7083-f473-48b5-b71d-4356912202a1/volumes"
Jul 14 01:43:47.357644 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.357603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:43:47.360569 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.360541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:43:47.361162 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361113    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.361210 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361168    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.361210 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361185    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.361210 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361193    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.361327 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361315    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.361363 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.361331    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6d7083-f473-48b5-b71d-4356912202a1" containerName="istio-proxy"
Jul 14 01:43:47.366295 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.366273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.368780 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.368761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e42ce1-openshift-default-dockercfg-57st4\""
Jul 14 01:43:47.375429 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.375408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:43:47.431453 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431623 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431623 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431623 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431623 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlvk\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431764 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431764 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431826 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.431826 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.431817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlvk\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.532756 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533076 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.532807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533281 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.533173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533281 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.533219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533356 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.533301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.533634 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.533607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.534087 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.534056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.535891 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.535867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.536117 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.535996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.541089 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.541065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlvk\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.541274 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.541259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token\") pod \"e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") " pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.678836 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.678748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:47.826649 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.826619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:43:47.830710 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:43:47.830679    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fa2f84f_e35e_431f_8e90_58b4d5a0f28e.slice/crio-7207464d6d6e325595ac07b5cb58f594710a4214edf38f8d9e96aa129bdddefc WatchSource:0}: Error finding container 7207464d6d6e325595ac07b5cb58f594710a4214edf38f8d9e96aa129bdddefc: Status 404 returned error can't find the container with id 7207464d6d6e325595ac07b5cb58f594710a4214edf38f8d9e96aa129bdddefc
Jul 14 01:43:47.833184 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.833153    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:43:47.833276 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.833216    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:43:47.833276 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:47.833246    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:43:48.550685 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:48.550654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerStarted","Data":"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"}
Jul 14 01:43:48.551074 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:48.550702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerStarted","Data":"7207464d6d6e325595ac07b5cb58f594710a4214edf38f8d9e96aa129bdddefc"}
Jul 14 01:43:48.571237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:48.571189    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podStartSLOduration=1.571173282 podStartE2EDuration="1.571173282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:43:48.57074581 +0000 UTC m=+2621.972057302" watchObservedRunningTime="2026-07-14 01:43:48.571173282 +0000 UTC m=+2621.972484773"
Jul 14 01:43:48.679749 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:48.679714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:48.686342 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:48.686320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:49.555827 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:49.555792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:49.556741 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:49.556725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:43:56.750017 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:43:56.749984    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:44:04.557158 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.557111    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 01:44:04.557616 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.557177    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 01:44:04.644284 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.644206    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerID="6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44" exitCode=0
Jul 14 01:44:04.644423 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.644283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerDied","Data":"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"}
Jul 14 01:44:04.644711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.644697    2565 scope.go:117] "RemoveContainer" containerID="6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"
Jul 14 01:44:04.645746 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.645723    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:44:04.645804 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.645788    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:44:04.645843 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:04.645826    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 14 01:44:05.651361 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:05.651325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerStarted","Data":"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"}
Jul 14 01:44:05.679561 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:05.679529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:44:05.679741 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:05.679723    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 01:44:05.679791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:05.679765    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 01:44:06.679441 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:06.679403    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 01:44:06.679856 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:06.679468    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 01:44:07.679811 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:07.679775    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 01:44:07.680176 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:07.679841    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 01:44:08.679876 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:08.679842    2565 patch_prober.go:28] interesting pod/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 14 01:44:08.680295 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:08.679904    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 14 01:44:09.683870 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.683842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:44:09.684270 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.684109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:44:09.684766 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.684750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:44:09.946026 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.945950    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:44:09.951269 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.951245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:09.953923 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.953880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"openshift-service-ca.crt\""
Jul 14 01:44:09.953923 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.953885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"kube-root-ca.crt\""
Jul 14 01:44:09.954098 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.953933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"default-dockercfg-xlj5p\""
Jul 14 01:44:09.954098 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.953986    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"auth-test-model-99e8d0-kserve-self-signed-certs\""
Jul 14 01:44:09.958528 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:09.958505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:44:10.065688 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.065851 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4dzk\" (UniqueName: \"kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.065851 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.065851 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.065961 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.065961 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.065915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167183 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4dzk\" (UniqueName: \"kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167374 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167655 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.167711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.167680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.169661 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.169637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.169971 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.169955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.175763 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.175739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4dzk\" (UniqueName: \"kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk\") pod \"auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") " pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.261819 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.261729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:10.399285 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.399257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:44:10.400987 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:44:10.400954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cb922e7_49d2_4be8_833a_744edaafc71d.slice/crio-96036110ee631c866fa19babd417ed4877e3f0692bd6e99b9738222153dcfbf2 WatchSource:0}: Error finding container 96036110ee631c866fa19babd417ed4877e3f0692bd6e99b9738222153dcfbf2: Status 404 returned error can't find the container with id 96036110ee631c866fa19babd417ed4877e3f0692bd6e99b9738222153dcfbf2
Jul 14 01:44:10.678693 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.678655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" event={"ID":"7cb922e7-49d2-4be8-833a-744edaafc71d","Type":"ContainerStarted","Data":"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"}
Jul 14 01:44:10.678693 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.678704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" event={"ID":"7cb922e7-49d2-4be8-833a-744edaafc71d","Type":"ContainerStarted","Data":"96036110ee631c866fa19babd417ed4877e3f0692bd6e99b9738222153dcfbf2"}
Jul 14 01:44:10.696351 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:10.696305    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" podStartSLOduration=1.696290881 podStartE2EDuration="1.696290881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:44:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:44:10.694254073 +0000 UTC m=+2644.095565590" watchObservedRunningTime="2026-07-14 01:44:10.696290881 +0000 UTC m=+2644.097602373"
Jul 14 01:44:13.248744 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:13.248701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:44:20.262872 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:20.262832    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:20.263350 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:20.262885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:20.276035 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:20.276007    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:20.742528 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:20.742498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:44:41.651987 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.651946    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:44:41.655711 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.655692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.659482 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.659460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"auth-test-model-e42ce1-kserve-self-signed-certs\""
Jul 14 01:44:41.659693 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.659503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"default-dockercfg-pwkml\""
Jul 14 01:44:41.659817 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.659514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"kube-root-ca.crt\""
Jul 14 01:44:41.659904 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.659576    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"openshift-service-ca.crt\""
Jul 14 01:44:41.664009 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.663985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:44:41.763823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.763787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.764013 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.763835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.764013 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.763857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.764013 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.763985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmq6\" (UniqueName: \"kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.764196 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.764038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.764245 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.764196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.864945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.864908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmq6\" (UniqueName: \"kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.864945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.864947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865221 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865221 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865221 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865221 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865548 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865548 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.865675 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.865566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.867449 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.867427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.867723 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.867705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.872902 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.872884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmq6\" (UniqueName: \"kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6\") pod \"auth-test-model-e42ce1-kserve-694f57587-j7rcx\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") " pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:41.967832 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:41.967745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:42.106481 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:42.106445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:44:42.110578 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:44:42.110548    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5633f1a_20de_4efa_b46a_14a681cb81e5.slice/crio-602c61458253fc72772228b9b48761d16253172c9119988a485df13d2516d470 WatchSource:0}: Error finding container 602c61458253fc72772228b9b48761d16253172c9119988a485df13d2516d470: Status 404 returned error can't find the container with id 602c61458253fc72772228b9b48761d16253172c9119988a485df13d2516d470
Jul 14 01:44:42.846497 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:42.846461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" event={"ID":"f5633f1a-20de-4efa-b46a-14a681cb81e5","Type":"ContainerStarted","Data":"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"}
Jul 14 01:44:42.846960 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:42.846509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" event={"ID":"f5633f1a-20de-4efa-b46a-14a681cb81e5","Type":"ContainerStarted","Data":"602c61458253fc72772228b9b48761d16253172c9119988a485df13d2516d470"}
Jul 14 01:44:42.863694 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:42.863644    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" podStartSLOduration=1.863628287 podStartE2EDuration="1.863628287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:44:42.862560477 +0000 UTC m=+2676.263871968" watchObservedRunningTime="2026-07-14 01:44:42.863628287 +0000 UTC m=+2676.264939778"
Jul 14 01:44:45.046242 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:45.046202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:44:51.968142 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:51.968099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:51.968551 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:51.968178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:51.980198 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:51.980109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:44:52.911496 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:44:52.911467    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:45:03.945494 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:03.945415    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:45:07.607744 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:07.607716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:45:07.616757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:07.616731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:45:07.620150 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:07.620114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:45:07.627773 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:07.627755    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:45:19.845471 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:19.845434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:45:35.144777 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:35.144744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:45:52.553734 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:45:52.553698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:46:09.454310 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:09.454274    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:46:26.042158 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:26.042102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:46:40.231616 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:40.231580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:46:41.038894 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:41.038854    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:46:44.842817 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:44.842774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:46:55.252532 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.252463    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" podUID="7cb922e7-49d2-4be8-833a-744edaafc71d" containerName="main" containerID="cri-o://22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599" gracePeriod=45
Jul 14 01:46:55.287607 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:46:55.287564    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cb922e7_49d2_4be8_833a_744edaafc71d.slice/crio-22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cb922e7_49d2_4be8_833a_744edaafc71d.slice/crio-conmon-22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599.scope\": RecentStats: unable to find data in memory cache]"
Jul 14 01:46:55.512167 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.512082    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:46:55.532194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.532164    2565 generic.go:356] "Generic (PLEG): container finished" podID="7cb922e7-49d2-4be8-833a-744edaafc71d" containerID="22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599" exitCode=0
Jul 14 01:46:55.532334 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.532236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" event={"ID":"7cb922e7-49d2-4be8-833a-744edaafc71d","Type":"ContainerDied","Data":"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"}
Jul 14 01:46:55.532334 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.532281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp" event={"ID":"7cb922e7-49d2-4be8-833a-744edaafc71d","Type":"ContainerDied","Data":"96036110ee631c866fa19babd417ed4877e3f0692bd6e99b9738222153dcfbf2"}
Jul 14 01:46:55.532334 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.532295    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"
Jul 14 01:46:55.532498 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.532301    2565 scope.go:117] "RemoveContainer" containerID="22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"
Jul 14 01:46:55.542056 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.542028    2565 scope.go:117] "RemoveContainer" containerID="22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"
Jul 14 01:46:55.542309 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:46:55.542292    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599\": container with ID starting with 22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599 not found: ID does not exist" containerID="22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"
Jul 14 01:46:55.542401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.542318    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599"} err="failed to get container status \"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599\": rpc error: code = NotFound desc = could not find container \"22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599\": container with ID starting with 22e18c7aa37968865f76e7861dbb2d16a57fe6306d02e4f57dbc3845000d4599 not found: ID does not exist"
Jul 14 01:46:55.561693 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.561803 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.561803 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561792    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.561917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.561917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4dzk\" (UniqueName: \"kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.561917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.561910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home\") pod \"7cb922e7-49d2-4be8-833a-744edaafc71d\" (UID: \"7cb922e7-49d2-4be8-833a-744edaafc71d\") "
Jul 14 01:46:55.562068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.562018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:55.562147 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.562101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:55.562312 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.562287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home" (OuterVolumeSpecName: "home") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:55.562405 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.562331    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.562405 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.562371    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.563917 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.563890    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:46:55.563995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.563916    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm" (OuterVolumeSpecName: "dshm") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:55.563995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.563969    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk" (OuterVolumeSpecName: "kube-api-access-r4dzk") pod "7cb922e7-49d2-4be8-833a-744edaafc71d" (UID: "7cb922e7-49d2-4be8-833a-744edaafc71d"). InnerVolumeSpecName "kube-api-access-r4dzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:46:55.663558 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.663525    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.663558 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.663553    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cb922e7-49d2-4be8-833a-744edaafc71d-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.663558 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.663563    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4dzk\" (UniqueName: \"kubernetes.io/projected/7cb922e7-49d2-4be8-833a-744edaafc71d-kube-api-access-r4dzk\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.663792 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.663571    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cb922e7-49d2-4be8-833a-744edaafc71d-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:55.852878 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.852853    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:46:55.858156 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:55.858095    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/auth-test-model-99e8d0-kserve-588bc5c9bc-vc8kp"]
Jul 14 01:46:56.060289 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.060242    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" podUID="f5633f1a-20de-4efa-b46a-14a681cb81e5" containerName="main" containerID="cri-o://95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2" gracePeriod=45
Jul 14 01:46:56.320175 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.320152    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:46:56.369021 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.368992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369235 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369066    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369235 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369110    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpmq6\" (UniqueName: \"kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369235 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369403 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369403 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir\") pod \"f5633f1a-20de-4efa-b46a-14a681cb81e5\" (UID: \"f5633f1a-20de-4efa-b46a-14a681cb81e5\") "
Jul 14 01:46:56.369528 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home" (OuterVolumeSpecName: "home") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:56.369588 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:56.369700 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369682    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:56.369758 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369730    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.369758 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.369747    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.371657 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.371631    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:46:56.371753 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.371707    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm" (OuterVolumeSpecName: "dshm") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:46:56.371801 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.371743    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6" (OuterVolumeSpecName: "kube-api-access-dpmq6") pod "f5633f1a-20de-4efa-b46a-14a681cb81e5" (UID: "f5633f1a-20de-4efa-b46a-14a681cb81e5"). InnerVolumeSpecName "kube-api-access-dpmq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:46:56.470910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.470824    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5633f1a-20de-4efa-b46a-14a681cb81e5-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.470910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.470851    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpmq6\" (UniqueName: \"kubernetes.io/projected/f5633f1a-20de-4efa-b46a-14a681cb81e5-kube-api-access-dpmq6\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.470910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.470863    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.470910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.470873    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5633f1a-20de-4efa-b46a-14a681cb81e5-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:46:56.539955 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.539922    2565 generic.go:356] "Generic (PLEG): container finished" podID="f5633f1a-20de-4efa-b46a-14a681cb81e5" containerID="95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2" exitCode=0
Jul 14 01:46:56.540114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.539967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"
Jul 14 01:46:56.540114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.540012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" event={"ID":"f5633f1a-20de-4efa-b46a-14a681cb81e5","Type":"ContainerDied","Data":"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"}
Jul 14 01:46:56.540114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.540056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx" event={"ID":"f5633f1a-20de-4efa-b46a-14a681cb81e5","Type":"ContainerDied","Data":"602c61458253fc72772228b9b48761d16253172c9119988a485df13d2516d470"}
Jul 14 01:46:56.540114 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.540078    2565 scope.go:117] "RemoveContainer" containerID="95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"
Jul 14 01:46:56.556549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.556529    2565 scope.go:117] "RemoveContainer" containerID="95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"
Jul 14 01:46:56.556860 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:46:56.556837    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2\": container with ID starting with 95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2 not found: ID does not exist" containerID="95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"
Jul 14 01:46:56.556956 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.556869    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2"} err="failed to get container status \"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2\": rpc error: code = NotFound desc = could not find container \"95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2\": container with ID starting with 95ce2d498305d71cde0a70f1c305b21771f4da4f97fca7e068bcd8b493a556d2 not found: ID does not exist"
Jul 14 01:46:56.566116 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.566091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:46:56.571633 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:56.571611    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/auth-test-model-e42ce1-kserve-694f57587-j7rcx"]
Jul 14 01:46:57.170876 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:57.170846    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb922e7-49d2-4be8-833a-744edaafc71d" path="/var/lib/kubelet/pods/7cb922e7-49d2-4be8-833a-744edaafc71d/volumes"
Jul 14 01:46:57.171285 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:46:57.171270    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5633f1a-20de-4efa-b46a-14a681cb81e5" path="/var/lib/kubelet/pods/f5633f1a-20de-4efa-b46a-14a681cb81e5/volumes"
Jul 14 01:47:00.160179 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:00.160136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:47:28.352308 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.352270    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:47:28.352909 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.352889    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb922e7-49d2-4be8-833a-744edaafc71d" containerName="main"
Jul 14 01:47:28.352966 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.352914    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb922e7-49d2-4be8-833a-744edaafc71d" containerName="main"
Jul 14 01:47:28.352966 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.352954    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5633f1a-20de-4efa-b46a-14a681cb81e5" containerName="main"
Jul 14 01:47:28.352966 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.352963    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5633f1a-20de-4efa-b46a-14a681cb81e5" containerName="main"
Jul 14 01:47:28.353068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.353060    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb922e7-49d2-4be8-833a-744edaafc71d" containerName="main"
Jul 14 01:47:28.353102 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.353075    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5633f1a-20de-4efa-b46a-14a681cb81e5" containerName="main"
Jul 14 01:47:28.356551 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.356532    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.360213 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.360189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"kube-root-ca.crt\""
Jul 14 01:47:28.360382 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.360211    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"openshift-service-ca.crt\""
Jul 14 01:47:28.360464 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.360209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"sub-test-model-e42ce1-kserve-self-signed-certs\""
Jul 14 01:47:28.360539 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.360288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"default-dockercfg-pwkml\""
Jul 14 01:47:28.366029 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.366005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:47:28.461874 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.461840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.462068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.461901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.462068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.461956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlfj\" (UniqueName: \"kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.462068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.462017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.462068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.462047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.462292 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.462073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlfj\" (UniqueName: \"kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563855 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563914 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.563965 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.563950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.565807 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.565791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.566104 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.566089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.571292 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.571269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlfj\" (UniqueName: \"kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj\") pod \"sub-test-model-e42ce1-kserve-57986cd5f-ctzqb\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") " pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.668987 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.668893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:28.805010 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:28.804871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:47:28.807474 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:47:28.807443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93e6fff9_c34e_4e7e_ab57_53682f608a8b.slice/crio-c451c2c128a50199be93a45d4cc84ecaf6e441202c577885da75186a3a664d9f WatchSource:0}: Error finding container c451c2c128a50199be93a45d4cc84ecaf6e441202c577885da75186a3a664d9f: Status 404 returned error can't find the container with id c451c2c128a50199be93a45d4cc84ecaf6e441202c577885da75186a3a664d9f
Jul 14 01:47:29.708857 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:29.708828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" event={"ID":"93e6fff9-c34e-4e7e-ab57-53682f608a8b","Type":"ContainerStarted","Data":"173851e28374b25f36687aa6cdd0be8e67e6873571393a3f8bc8b30ec1fa261b"}
Jul 14 01:47:29.709292 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:29.708864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" event={"ID":"93e6fff9-c34e-4e7e-ab57-53682f608a8b","Type":"ContainerStarted","Data":"c451c2c128a50199be93a45d4cc84ecaf6e441202c577885da75186a3a664d9f"}
Jul 14 01:47:29.726769 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:29.726712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" podStartSLOduration=1.726691049 podStartE2EDuration="1.726691049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:47:29.725944636 +0000 UTC m=+2843.127256127" watchObservedRunningTime="2026-07-14 01:47:29.726691049 +0000 UTC m=+2843.128002541"
Jul 14 01:47:32.742808 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:32.742775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:47:38.669414 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:38.669373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:38.669836 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:38.669458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:38.681774 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:38.681748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:38.765953 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:38.765919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:47:57.246318 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:47:57.246286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:48:14.246928 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:14.246894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:48:19.824818 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:19.824790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:48:27.047491 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.047449    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:48:27.051269 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.051245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.054005 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.053981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"kube-root-ca.crt\""
Jul 14 01:48:27.054950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.054929    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"default-dockercfg-xlj5p\""
Jul 14 01:48:27.054950 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.054946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"rate-test-model-99e8d0-kserve-self-signed-certs\""
Jul 14 01:48:27.055145 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.054975    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-99e8d0\"/\"openshift-service-ca.crt\""
Jul 14 01:48:27.059879 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.059853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:48:27.101174 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvbv\" (UniqueName: \"kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.101337 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.101337 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.101413 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.101413 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.101480 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.101428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.202945 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.202912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.202986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvbv\" (UniqueName: \"kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203178 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203345 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203595 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203731 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.203731 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.203691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.205467 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.205445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.205823 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.205803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.210660 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.210638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvbv\" (UniqueName: \"kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv\") pod \"rate-test-model-99e8d0-kserve-54459f7759-45zb7\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") " pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.362092 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.362006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:27.498737 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:27.498701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:48:27.502479 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:48:27.502448    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2eb0d1cd_5a38_4836_91cf_d09326d9f70f.slice/crio-8db3c3faeb1e778627e0e79ef58d0bf30c0d96323b1138b6fd76d348969ef04e WatchSource:0}: Error finding container 8db3c3faeb1e778627e0e79ef58d0bf30c0d96323b1138b6fd76d348969ef04e: Status 404 returned error can't find the container with id 8db3c3faeb1e778627e0e79ef58d0bf30c0d96323b1138b6fd76d348969ef04e
Jul 14 01:48:28.006552 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:28.006518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" event={"ID":"2eb0d1cd-5a38-4836-91cf-d09326d9f70f","Type":"ContainerStarted","Data":"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"}
Jul 14 01:48:28.006727 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:28.006559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" event={"ID":"2eb0d1cd-5a38-4836-91cf-d09326d9f70f","Type":"ContainerStarted","Data":"8db3c3faeb1e778627e0e79ef58d0bf30c0d96323b1138b6fd76d348969ef04e"}
Jul 14 01:48:28.022729 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:28.022683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" podStartSLOduration=1.022668793 podStartE2EDuration="1.022668793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:48:28.020939939 +0000 UTC m=+2901.422251426" watchObservedRunningTime="2026-07-14 01:48:28.022668793 +0000 UTC m=+2901.423980283"
Jul 14 01:48:33.651321 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:33.651281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:48:34.845910 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:34.845868    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" podUID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" containerName="main" containerID="cri-o://173851e28374b25f36687aa6cdd0be8e67e6873571393a3f8bc8b30ec1fa261b" gracePeriod=45
Jul 14 01:48:35.045969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.045784    2565 generic.go:356] "Generic (PLEG): container finished" podID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" containerID="173851e28374b25f36687aa6cdd0be8e67e6873571393a3f8bc8b30ec1fa261b" exitCode=0
Jul 14 01:48:35.045969 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.045827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" event={"ID":"93e6fff9-c34e-4e7e-ab57-53682f608a8b","Type":"ContainerDied","Data":"173851e28374b25f36687aa6cdd0be8e67e6873571393a3f8bc8b30ec1fa261b"}
Jul 14 01:48:35.117450 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.117425    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:48:35.190617 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.190797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190634    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.190797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190658    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.190797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rlfj\" (UniqueName: \"kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.190797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.190797 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home\") pod \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\" (UID: \"93e6fff9-c34e-4e7e-ab57-53682f608a8b\") "
Jul 14 01:48:35.191068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190895    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:48:35.191068 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.190955    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:48:35.191217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.191065    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home" (OuterVolumeSpecName: "home") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:48:35.191217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.191204    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:35.191325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.191219    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:35.191325 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.191229    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:35.193183 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.193156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm" (OuterVolumeSpecName: "dshm") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:48:35.193337 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.193318    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj" (OuterVolumeSpecName: "kube-api-access-6rlfj") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "kube-api-access-6rlfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:48:35.193401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.193334    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93e6fff9-c34e-4e7e-ab57-53682f608a8b" (UID: "93e6fff9-c34e-4e7e-ab57-53682f608a8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:48:35.292718 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.292685    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93e6fff9-c34e-4e7e-ab57-53682f608a8b-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:35.292718 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.292712    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rlfj\" (UniqueName: \"kubernetes.io/projected/93e6fff9-c34e-4e7e-ab57-53682f608a8b-kube-api-access-6rlfj\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:35.292961 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:35.292728    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93e6fff9-c34e-4e7e-ab57-53682f608a8b-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:48:36.052016 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:36.051979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb" event={"ID":"93e6fff9-c34e-4e7e-ab57-53682f608a8b","Type":"ContainerDied","Data":"c451c2c128a50199be93a45d4cc84ecaf6e441202c577885da75186a3a664d9f"}
Jul 14 01:48:36.052477 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:36.052030    2565 scope.go:117] "RemoveContainer" containerID="173851e28374b25f36687aa6cdd0be8e67e6873571393a3f8bc8b30ec1fa261b"
Jul 14 01:48:36.052477 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:36.051999    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"
Jul 14 01:48:36.073925 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:36.073896    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:48:36.075601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:36.075582    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/sub-test-model-e42ce1-kserve-57986cd5f-ctzqb"]
Jul 14 01:48:37.170833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:37.170798    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" path="/var/lib/kubelet/pods/93e6fff9-c34e-4e7e-ab57-53682f608a8b/volumes"
Jul 14 01:48:37.362375 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:37.362347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:37.362573 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:37.362396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:37.374625 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:37.374601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:38.073689 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:38.073665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:48:57.548779 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.548748    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:48:57.549175 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.549153    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" containerName="main"
Jul 14 01:48:57.549175 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.549165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" containerName="main"
Jul 14 01:48:57.549261 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.549239    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e6fff9-c34e-4e7e-ab57-53682f608a8b" containerName="main"
Jul 14 01:48:57.552340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.552321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.554754 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.554736    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"openshift-service-ca.crt\""
Jul 14 01:48:57.555882 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.555857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"rate-test-model-e42ce1-kserve-self-signed-certs\""
Jul 14 01:48:57.555990 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.555874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"default-dockercfg-pwkml\""
Jul 14 01:48:57.556310 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.556273    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e42ce1\"/\"kube-root-ca.crt\""
Jul 14 01:48:57.560853 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.560830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:48:57.706659 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.706869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.706869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55tm\" (UniqueName: \"kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.706869 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.707028 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.707028 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.706903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808470 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808470 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808470 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808757 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55tm\" (UniqueName: \"kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808913 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.808913 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.808862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.809201 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.809173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.810812 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.810793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.811200 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.811182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.816515 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.816490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55tm\" (UniqueName: \"kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm\") pod \"rate-test-model-e42ce1-kserve-7866798855-8vkvl\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") " pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:57.863412 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:57.863371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:48:58.003560 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:58.003461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:48:58.006293 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:48:58.006268    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd355e183_1012_40e5_b07a_4f2eef14c1a3.slice/crio-59ffa9f7b14fc715fc30bad472126944570551792d82c8a8972614ba62b1a4ad WatchSource:0}: Error finding container 59ffa9f7b14fc715fc30bad472126944570551792d82c8a8972614ba62b1a4ad: Status 404 returned error can't find the container with id 59ffa9f7b14fc715fc30bad472126944570551792d82c8a8972614ba62b1a4ad
Jul 14 01:48:58.169682 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:58.169647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" event={"ID":"d355e183-1012-40e5-b07a-4f2eef14c1a3","Type":"ContainerStarted","Data":"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"}
Jul 14 01:48:58.169852 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:58.169693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" event={"ID":"d355e183-1012-40e5-b07a-4f2eef14c1a3","Type":"ContainerStarted","Data":"59ffa9f7b14fc715fc30bad472126944570551792d82c8a8972614ba62b1a4ad"}
Jul 14 01:48:58.185050 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:48:58.185001    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" podStartSLOduration=1.18498502 podStartE2EDuration="1.18498502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:48:58.184282241 +0000 UTC m=+2931.585593733" watchObservedRunningTime="2026-07-14 01:48:58.18498502 +0000 UTC m=+2931.586296557"
Jul 14 01:49:02.044893 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:02.044860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:49:07.863908 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:07.863872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:49:07.864381 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:07.863951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:49:07.877390 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:07.877369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:49:08.237617 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:08.237590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:49:17.150695 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:17.150658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:49:39.645544 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:39.645508    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:49:43.845401 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:43.845366    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:49:44.724979 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:44.724944    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:49:54.860809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:54.860774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:49:58.866262 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:58.866217    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" podUID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" containerName="main" containerID="cri-o://fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98" gracePeriod=45
Jul 14 01:49:59.121712 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.121654    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:49:59.201895 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.201858    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202096 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.201904    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202096 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.201937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202096 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.201988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202096 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgvbv\" (UniqueName: \"kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202096 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home\") pod \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\" (UID: \"2eb0d1cd-5a38-4836-91cf-d09326d9f70f\") "
Jul 14 01:49:59.202412 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:49:59.202412 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache" (OuterVolumeSpecName: "model-cache") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:49:59.202515 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202476    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.202570 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202519    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.202570 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.202544    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home" (OuterVolumeSpecName: "home") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:49:59.204267 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.204245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm" (OuterVolumeSpecName: "dshm") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:49:59.204368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.204303    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:49:59.204368 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.204314    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv" (OuterVolumeSpecName: "kube-api-access-tgvbv") pod "2eb0d1cd-5a38-4836-91cf-d09326d9f70f" (UID: "2eb0d1cd-5a38-4836-91cf-d09326d9f70f"). InnerVolumeSpecName "kube-api-access-tgvbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:49:59.303897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.303862    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.303897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.303890    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.303897 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.303900    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgvbv\" (UniqueName: \"kubernetes.io/projected/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-kube-api-access-tgvbv\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.304211 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.303909    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb0d1cd-5a38-4836-91cf-d09326d9f70f-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:49:59.495970 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.495880    2565 generic.go:356] "Generic (PLEG): container finished" podID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" containerID="fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98" exitCode=0
Jul 14 01:49:59.495970 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.495922    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"
Jul 14 01:49:59.495970 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.495959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" event={"ID":"2eb0d1cd-5a38-4836-91cf-d09326d9f70f","Type":"ContainerDied","Data":"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"}
Jul 14 01:49:59.496237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.496008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7" event={"ID":"2eb0d1cd-5a38-4836-91cf-d09326d9f70f","Type":"ContainerDied","Data":"8db3c3faeb1e778627e0e79ef58d0bf30c0d96323b1138b6fd76d348969ef04e"}
Jul 14 01:49:59.496237 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.496026    2565 scope.go:117] "RemoveContainer" containerID="fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"
Jul 14 01:49:59.506394 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.506376    2565 scope.go:117] "RemoveContainer" containerID="fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"
Jul 14 01:49:59.506650 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:49:59.506630    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98\": container with ID starting with fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98 not found: ID does not exist" containerID="fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"
Jul 14 01:49:59.506718 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.506660    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98"} err="failed to get container status \"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98\": rpc error: code = NotFound desc = could not find container \"fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98\": container with ID starting with fe9cfdb1cacf3c448d8a2d9dc0a91cf9ead592d400432b3e257a97d464fc5f98 not found: ID does not exist"
Jul 14 01:49:59.519665 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.519642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:49:59.522529 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.522503    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-99e8d0/rate-test-model-99e8d0-kserve-54459f7759-45zb7"]
Jul 14 01:49:59.746488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:49:59.746382    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" podUID="d355e183-1012-40e5-b07a-4f2eef14c1a3" containerName="main" containerID="cri-o://737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c" gracePeriod=45
Jul 14 01:50:00.004139 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.004046    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:50:00.110874 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.110836    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.110885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.110909    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t55tm\" (UniqueName: \"kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111053 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111277 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache\") pod \"d355e183-1012-40e5-b07a-4f2eef14c1a3\" (UID: \"d355e183-1012-40e5-b07a-4f2eef14c1a3\") "
Jul 14 01:50:00.111367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home" (OuterVolumeSpecName: "home") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:50:00.111504 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:50:00.111628 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache" (OuterVolumeSpecName: "model-cache") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:50:00.111628 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111623    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-home\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.111628 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111638    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-tmp-dir\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.111628 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.111652    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-model-cache\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.113242 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.113224    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm" (OuterVolumeSpecName: "dshm") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:50:00.113748 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.113721    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm" (OuterVolumeSpecName: "kube-api-access-t55tm") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "kube-api-access-t55tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:50:00.113748 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.113733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d355e183-1012-40e5-b07a-4f2eef14c1a3" (UID: "d355e183-1012-40e5-b07a-4f2eef14c1a3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 01:50:00.212928 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.212891    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d355e183-1012-40e5-b07a-4f2eef14c1a3-dshm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.212928 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.212919    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d355e183-1012-40e5-b07a-4f2eef14c1a3-tls-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.212928 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.212931    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55tm\" (UniqueName: \"kubernetes.io/projected/d355e183-1012-40e5-b07a-4f2eef14c1a3-kube-api-access-t55tm\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:50:00.504333 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.504299    2565 generic.go:356] "Generic (PLEG): container finished" podID="d355e183-1012-40e5-b07a-4f2eef14c1a3" containerID="737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c" exitCode=0
Jul 14 01:50:00.504514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.504345    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"
Jul 14 01:50:00.504514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.504376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" event={"ID":"d355e183-1012-40e5-b07a-4f2eef14c1a3","Type":"ContainerDied","Data":"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"}
Jul 14 01:50:00.504514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.504413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl" event={"ID":"d355e183-1012-40e5-b07a-4f2eef14c1a3","Type":"ContainerDied","Data":"59ffa9f7b14fc715fc30bad472126944570551792d82c8a8972614ba62b1a4ad"}
Jul 14 01:50:00.504514 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.504436    2565 scope.go:117] "RemoveContainer" containerID="737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"
Jul 14 01:50:00.514201 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.514181    2565 scope.go:117] "RemoveContainer" containerID="737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"
Jul 14 01:50:00.514455 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:50:00.514435    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c\": container with ID starting with 737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c not found: ID does not exist" containerID="737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"
Jul 14 01:50:00.514518 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.514466    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c"} err="failed to get container status \"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c\": rpc error: code = NotFound desc = could not find container \"737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c\": container with ID starting with 737572cac657618a80f2ffcc9e164870d435d6edbd08707db7b9bfe8e5a0464c not found: ID does not exist"
Jul 14 01:50:00.528391 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.528366    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:50:00.534907 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:00.534885    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e42ce1/rate-test-model-e42ce1-kserve-7866798855-8vkvl"]
Jul 14 01:50:01.173606 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:01.173562    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" path="/var/lib/kubelet/pods/2eb0d1cd-5a38-4836-91cf-d09326d9f70f/volumes"
Jul 14 01:50:01.174264 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:01.174240    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d355e183-1012-40e5-b07a-4f2eef14c1a3" path="/var/lib/kubelet/pods/d355e183-1012-40e5-b07a-4f2eef14c1a3/volumes"
Jul 14 01:50:07.647488 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:07.647457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:50:07.654930 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:07.654908    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:50:07.655936 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:07.655912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:50:07.662112 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:07.662094    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:50:17.647489 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:17.647455    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:50:43.747111 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:43.747076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hgnfl"]
Jul 14 01:50:55.880706 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:55.880675    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:50:55.881270 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:55.880853    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy" containerID="cri-o://06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe" gracePeriod=30
Jul 14 01:50:56.607394 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:50:56.607343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bd644cb6f-8qjfx_d04b72f5-e0b6-4082-a298-d55f1be49bda/authorino/0.log"
Jul 14 01:51:01.145213 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.145184    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:51:01.289004 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.288978    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhlvk\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289215 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289507 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289507 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:51:01.289507 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289507 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket\") pod \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\" (UID: \"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e\") "
Jul 14 01:51:01.289725 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:51:01.289725 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289664    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 01:51:01.289725 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.289713    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-certs\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.290116 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.290093    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:51:01.290425 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.290394    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:51:01.291406 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.291383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 01:51:01.291646 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.291616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk" (OuterVolumeSpecName: "kube-api-access-jhlvk") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "kube-api-access-jhlvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:51:01.291646 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.291624    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 01:51:01.292916 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.292891    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" (UID: "6fa2f84f-e35e-431f-8e90-58b4d5a0f28e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 01:51:01.390833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390796    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhlvk\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-kube-api-access-jhlvk\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.390833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390828    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-token\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.390833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390837    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-data\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.390833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390844    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-credential-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.391151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390853    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-workload-socket\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.391151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390861    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-podinfo\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.391151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390869    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istio-envoy\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.391151 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.390877    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e-istiod-ca-cert\") on node \"ip-10-0-137-153.ec2.internal\" DevicePath \"\""
Jul 14 01:51:01.426831 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.426800    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7fq5_dff5f622-a47a-43ce-a9c4-1951025f1c11/manager/0.log"
Jul 14 01:51:01.548649 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.548565    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hptf5_7e8e35e3-3476-4c51-abd2-8e981faa5acd/manager/0.log"
Jul 14 01:51:01.812672 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.812588    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerID="06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe" exitCode=0
Jul 14 01:51:01.812672 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.812648    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"
Jul 14 01:51:01.812848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.812667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerDied","Data":"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"}
Jul 14 01:51:01.812848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.812720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n" event={"ID":"6fa2f84f-e35e-431f-8e90-58b4d5a0f28e","Type":"ContainerDied","Data":"7207464d6d6e325595ac07b5cb58f594710a4214edf38f8d9e96aa129bdddefc"}
Jul 14 01:51:01.812848 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.812742    2565 scope.go:117] "RemoveContainer" containerID="06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"
Jul 14 01:51:01.822718 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.822697    2565 scope.go:117] "RemoveContainer" containerID="6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"
Jul 14 01:51:01.830821 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.830804    2565 scope.go:117] "RemoveContainer" containerID="06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"
Jul 14 01:51:01.831144 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:51:01.831101    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe\": container with ID starting with 06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe not found: ID does not exist" containerID="06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"
Jul 14 01:51:01.831217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.831156    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe"} err="failed to get container status \"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe\": rpc error: code = NotFound desc = could not find container \"06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe\": container with ID starting with 06e96dc6aa1ec16d0e1d6df65a20346fadd825951a7430eba5da37660396d4fe not found: ID does not exist"
Jul 14 01:51:01.831217 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.831181    2565 scope.go:117] "RemoveContainer" containerID="6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"
Jul 14 01:51:01.831432 ip-10-0-137-153 kubenswrapper[2565]: E0714 01:51:01.831416    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44\": container with ID starting with 6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44 not found: ID does not exist" containerID="6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"
Jul 14 01:51:01.831480 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.831437    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44"} err="failed to get container status \"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44\": rpc error: code = NotFound desc = could not find container \"6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44\": container with ID starting with 6c5a1e45a6ae1b0211e79af77e49103111b3c8438b16118fe1acf4cbe714af44 not found: ID does not exist"
Jul 14 01:51:01.834176 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.834098    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:51:01.837884 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.837865    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e42ce1-openshift-default-ddb7b6887-8729n"]
Jul 14 01:51:01.909905 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:01.909876    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mrtf4_cb865568-f767-42cf-8e4a-419a6dab79c9/manager/0.log"
Jul 14 01:51:02.269051 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:02.268973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc876bb4c-kf76m_d9b03b74-6bcd-4d52-8515-4d3d56ece46b/copy-manifests/0.log"
Jul 14 01:51:02.275377 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:02.275346    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc876bb4c-kf76m_d9b03b74-6bcd-4d52-8515-4d3d56ece46b/manager/0.log"
Jul 14 01:51:03.170986 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:03.170953    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" path="/var/lib/kubelet/pods/6fa2f84f-e35e-431f-8e90-58b4d5a0f28e/volumes"
Jul 14 01:51:05.635473 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:05.635440    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bd644cb6f-8qjfx_d04b72f5-e0b6-4082-a298-d55f1be49bda/authorino/0.log"
Jul 14 01:51:05.752860 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:05.752808    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6jqxc_3cf5eb34-a547-42af-9457-73c3eda2299f/manager/0.log"
Jul 14 01:51:05.858549 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:05.858523    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d6sjv_3088855b-8315-4cff-8d66-1c1d3ecf2b84/manager/0.log"
Jul 14 01:51:06.081593 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:06.081529    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qmfl2_3d6e0718-dd46-4544-a38a-703b84d699e6/registry-server/0.log"
Jul 14 01:51:06.207078 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:06.207053    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gxf46_b91de5a1-5517-423b-af8a-ef8a86103af4/manager/0.log"
Jul 14 01:51:06.318543 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:06.318517    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hgnfl_50f81d06-3ead-426a-b368-9351a8d4e8cd/limitador/0.log"
Jul 14 01:51:06.439749 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:06.439650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t8g2x_4869964f-caff-4ee9-aa8f-2d1de6e59c66/manager/0.log"
Jul 14 01:51:07.004802 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:07.004775    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d697d898-p7psj_48c8bb7f-7ad5-4924-a52d-4575132cad43/kube-auth-proxy/0.log"
Jul 14 01:51:07.238638 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:07.238611    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/1.log"
Jul 14 01:51:08.325398 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:08.325361    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dwl9q_dcc0451c-db3b-4794-b652-47f3f91ebb56/main/0.log"
Jul 14 01:51:08.438190 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:08.438158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-8pl4x_20cf405c-396a-4e18-b1c8-366ff9c9688c/main/0.log"
Jul 14 01:51:12.836003 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.835966    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-njqhj/must-gather-z9xmh"]
Jul 14 01:51:12.836415 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836402    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d355e183-1012-40e5-b07a-4f2eef14c1a3" containerName="main"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836417    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d355e183-1012-40e5-b07a-4f2eef14c1a3" containerName="main"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836425    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836431    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836443    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" containerName="main"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836449    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" containerName="main"
Jul 14 01:51:12.836461 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836461    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.836645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836466    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.836645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836518    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb0d1cd-5a38-4836-91cf-d09326d9f70f" containerName="main"
Jul 14 01:51:12.836645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836527    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.836645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836532    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d355e183-1012-40e5-b07a-4f2eef14c1a3" containerName="main"
Jul 14 01:51:12.836645 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.836645    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa2f84f-e35e-431f-8e90-58b4d5a0f28e" containerName="istio-proxy"
Jul 14 01:51:12.841601 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.841580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:12.844152 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.844107    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njqhj\"/\"openshift-service-ca.crt\""
Jul 14 01:51:12.844291 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.844239    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-njqhj\"/\"default-dockercfg-78zpm\""
Jul 14 01:51:12.844291 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.844259    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njqhj\"/\"kube-root-ca.crt\""
Jul 14 01:51:12.850531 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.850504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqhj/must-gather-z9xmh"]
Jul 14 01:51:12.894033 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.893994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42daaca6-cbc3-4591-9332-1e1e461b4c78-must-gather-output\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:12.894251 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.894044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46lbc\" (UniqueName: \"kubernetes.io/projected/42daaca6-cbc3-4591-9332-1e1e461b4c78-kube-api-access-46lbc\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:12.994854 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.994812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42daaca6-cbc3-4591-9332-1e1e461b4c78-must-gather-output\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:12.994854 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.994859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46lbc\" (UniqueName: \"kubernetes.io/projected/42daaca6-cbc3-4591-9332-1e1e461b4c78-kube-api-access-46lbc\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:12.995228 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:12.995210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42daaca6-cbc3-4591-9332-1e1e461b4c78-must-gather-output\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:13.002446 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:13.002424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46lbc\" (UniqueName: \"kubernetes.io/projected/42daaca6-cbc3-4591-9332-1e1e461b4c78-kube-api-access-46lbc\") pod \"must-gather-z9xmh\" (UID: \"42daaca6-cbc3-4591-9332-1e1e461b4c78\") " pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:13.151809 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:13.151720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqhj/must-gather-z9xmh"
Jul 14 01:51:13.287569 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:13.287538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqhj/must-gather-z9xmh"]
Jul 14 01:51:13.288666 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:51:13.288642    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42daaca6_cbc3_4591_9332_1e1e461b4c78.slice/crio-2f242cfff68077af29e627227cd77da54c301abc515e418d17baac97b3910f3e WatchSource:0}: Error finding container 2f242cfff68077af29e627227cd77da54c301abc515e418d17baac97b3910f3e: Status 404 returned error can't find the container with id 2f242cfff68077af29e627227cd77da54c301abc515e418d17baac97b3910f3e
Jul 14 01:51:13.290668 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:13.290653    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 01:51:13.881271 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:13.881231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqhj/must-gather-z9xmh" event={"ID":"42daaca6-cbc3-4591-9332-1e1e461b4c78","Type":"ContainerStarted","Data":"2f242cfff68077af29e627227cd77da54c301abc515e418d17baac97b3910f3e"}
Jul 14 01:51:14.889194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:14.889158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqhj/must-gather-z9xmh" event={"ID":"42daaca6-cbc3-4591-9332-1e1e461b4c78","Type":"ContainerStarted","Data":"1aa891eb95df9981789fc16b04ad0b7deaa609f8377eef041bae9ba3d80e207c"}
Jul 14 01:51:14.889194 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:14.889201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqhj/must-gather-z9xmh" event={"ID":"42daaca6-cbc3-4591-9332-1e1e461b4c78","Type":"ContainerStarted","Data":"9e1ba71119bee619ca02027be9dcf6526cab5fa35900d5757f94486d3ad0cdf5"}
Jul 14 01:51:14.906389 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:14.906321    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-njqhj/must-gather-z9xmh" podStartSLOduration=2.107365348 podStartE2EDuration="2.906300368s" totalImagesPullingTime="798.93502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:51:14.904064803 +0000 UTC m=+3068.305376295" watchObservedRunningTime="2026-07-14 01:51:14.906300368 +0000 UTC m=+3068.307611860"
Jul 14 01:51:15.561828 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:15.561802    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-htw8v_5b6eb8c7-8e78-42d8-ac58-c7e731c89583/global-pull-secret-syncer/0.log"
Jul 14 01:51:15.706876 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:15.706843    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8ttzd_3dafbaf1-9368-458e-96ce-a7a1793b2a97/konnectivity-agent/0.log"
Jul 14 01:51:15.790613 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:15.790584    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-153.ec2.internal_4ce38b53631ed0051e61ec9c603fcaa4/haproxy/0.log"
Jul 14 01:51:21.114030 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.113992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bd644cb6f-8qjfx_d04b72f5-e0b6-4082-a298-d55f1be49bda/authorino/0.log"
Jul 14 01:51:21.152541 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.152504    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6jqxc_3cf5eb34-a547-42af-9457-73c3eda2299f/manager/0.log"
Jul 14 01:51:21.199302 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.199264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d6sjv_3088855b-8315-4cff-8d66-1c1d3ecf2b84/manager/0.log"
Jul 14 01:51:21.283421 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.283325    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qmfl2_3d6e0718-dd46-4544-a38a-703b84d699e6/registry-server/0.log"
Jul 14 01:51:21.495198 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.495069    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gxf46_b91de5a1-5517-423b-af8a-ef8a86103af4/manager/0.log"
Jul 14 01:51:21.523039 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.523013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hgnfl_50f81d06-3ead-426a-b368-9351a8d4e8cd/limitador/0.log"
Jul 14 01:51:21.635995 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:21.635952    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t8g2x_4869964f-caff-4ee9-aa8f-2d1de6e59c66/manager/0.log"
Jul 14 01:51:22.924160 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:22.924107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/alertmanager/0.log"
Jul 14 01:51:22.946459 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:22.946427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/config-reloader/0.log"
Jul 14 01:51:22.966229 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:22.966193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/kube-rbac-proxy-web/0.log"
Jul 14 01:51:22.989299 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:22.989255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/kube-rbac-proxy/0.log"
Jul 14 01:51:23.006011 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.005982    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/kube-rbac-proxy-metric/0.log"
Jul 14 01:51:23.027858 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.027821    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/prom-label-proxy/0.log"
Jul 14 01:51:23.069818 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.069790    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e081723-63a7-4f21-bdf9-2fcae54830a6/init-config-reloader/0.log"
Jul 14 01:51:23.399681 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.399652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q259w_b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5/node-exporter/0.log"
Jul 14 01:51:23.430501 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.430460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q259w_b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5/kube-rbac-proxy/0.log"
Jul 14 01:51:23.445853 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.445827    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q259w_b0d6035a-7638-4a2a-9ff8-a81b06d8e3f5/init-textfile/0.log"
Jul 14 01:51:23.823273 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.823243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/thanos-query/0.log"
Jul 14 01:51:23.843504 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.843478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/kube-rbac-proxy-web/0.log"
Jul 14 01:51:23.864485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.864461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/kube-rbac-proxy/0.log"
Jul 14 01:51:23.884333 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.884304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/prom-label-proxy/0.log"
Jul 14 01:51:23.900367 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.900337    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/kube-rbac-proxy-rules/0.log"
Jul 14 01:51:23.918396 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:23.918356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66658f696-dd5lv_ee551b19-4238-4401-9789-1f03c1404274/kube-rbac-proxy-metrics/0.log"
Jul 14 01:51:25.744296 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:25.744254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/2.log"
Jul 14 01:51:25.749247 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:25.749222    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-x822p_b7c15590-6880-4f4f-92c9-39e078e1c125/console-operator/3.log"
Jul 14 01:51:26.252216 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.252190    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"]
Jul 14 01:51:26.257170 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.257141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.266091 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.266064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"]
Jul 14 01:51:26.284153 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.283752    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dffdb586f-dpn22_86d5aa89-3b90-475d-bd40-b7af32c0a973/console/0.log"
Jul 14 01:51:26.321143 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.320730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-jbn2k_e68ce7d2-1c3c-4f5a-b377-3b3adef7ba00/download-server/0.log"
Jul 14 01:51:26.353065 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.353019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-lib-modules\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.353280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.353133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-sys\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.353280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.353191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-podres\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.353280 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.353230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-proc\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.353457 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.353292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v285\" (UniqueName: \"kubernetes.io/projected/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-kube-api-access-4v285\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-podres\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-proc\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v285\" (UniqueName: \"kubernetes.io/projected/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-kube-api-access-4v285\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-proc\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-lib-modules\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-sys\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-sys\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.454522 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-lib-modules\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.455143 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.454707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-podres\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.462603 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.462576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v285\" (UniqueName: \"kubernetes.io/projected/7b30d868-0d93-4c90-9a98-1a2b04dfc63e-kube-api-access-4v285\") pod \"perf-node-gather-daemonset-9n5rm\" (UID: \"7b30d868-0d93-4c90-9a98-1a2b04dfc63e\") " pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.572012 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.571973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:26.755159 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.754975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"]
Jul 14 01:51:26.765203 ip-10-0-137-153 kubenswrapper[2565]: W0714 01:51:26.764700    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7b30d868_0d93_4c90_9a98_1a2b04dfc63e.slice/crio-4fcb1343c71891de8819c84843af63dd7fb5dc732492dd9ce0d59c1a2249c57b WatchSource:0}: Error finding container 4fcb1343c71891de8819c84843af63dd7fb5dc732492dd9ce0d59c1a2249c57b: Status 404 returned error can't find the container with id 4fcb1343c71891de8819c84843af63dd7fb5dc732492dd9ce0d59c1a2249c57b
Jul 14 01:51:26.982222 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.982174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm" event={"ID":"7b30d868-0d93-4c90-9a98-1a2b04dfc63e","Type":"ContainerStarted","Data":"16ce984ab6460ed61324b90742f47319ae9ead57c2fcfb9ef60f568640ee2eac"}
Jul 14 01:51:26.982416 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.982238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm" event={"ID":"7b30d868-0d93-4c90-9a98-1a2b04dfc63e","Type":"ContainerStarted","Data":"4fcb1343c71891de8819c84843af63dd7fb5dc732492dd9ce0d59c1a2249c57b"}
Jul 14 01:51:26.983163 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:26.983101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:27.001075 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:27.001013    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm" podStartSLOduration=1.000992508 podStartE2EDuration="1.000992508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:51:27.000697723 +0000 UTC m=+3080.402009233" watchObservedRunningTime="2026-07-14 01:51:27.000992508 +0000 UTC m=+3080.402304001"
Jul 14 01:51:27.983230 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:27.983176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xv6xw_b883267b-d699-4506-9721-2df37880c63c/dns/0.log"
Jul 14 01:51:27.998447 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:27.998419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xv6xw_b883267b-d699-4506-9721-2df37880c63c/kube-rbac-proxy/0.log"
Jul 14 01:51:28.053686 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:28.053656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxkrj_2b8164c2-4186-44a6-8c82-e9918e0b1408/dns-node-resolver/0.log"
Jul 14 01:51:28.531385 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:28.531355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75fdf94bc8-dlv5q_c1257988-23f1-46c0-9525-f8293789c2e7/registry/0.log"
Jul 14 01:51:28.551250 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:28.551214    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5g7tv_eaa4b0fc-eae2-4b87-82ca-39ea84c452c9/node-ca/0.log"
Jul 14 01:51:29.570627 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:29.570596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d697d898-p7psj_48c8bb7f-7ad5-4924-a52d-4575132cad43/kube-auth-proxy/0.log"
Jul 14 01:51:29.618765 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:29.618734    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/0.log"
Jul 14 01:51:29.684536 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:29.684496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/1.log"
Jul 14 01:51:30.483159 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:30.483101    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l9lzv_e55a38c3-eb9c-4d7b-9eb4-65a775e03812/serve-healthcheck-canary/0.log"
Jul 14 01:51:30.944847 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:30.944818    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nksx_aae0ac19-e3d4-41b3-b3d8-271fe15ffde3/kube-rbac-proxy/0.log"
Jul 14 01:51:30.960994 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:30.960966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nksx_aae0ac19-e3d4-41b3-b3d8-271fe15ffde3/exporter/0.log"
Jul 14 01:51:30.978144 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:30.978102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nksx_aae0ac19-e3d4-41b3-b3d8-271fe15ffde3/extractor/0.log"
Jul 14 01:51:33.108567 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:33.108526    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7fq5_dff5f622-a47a-43ce-a9c4-1951025f1c11/manager/0.log"
Jul 14 01:51:33.371832 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:33.371731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hptf5_7e8e35e3-3476-4c51-abd2-8e981faa5acd/manager/0.log"
Jul 14 01:51:33.677855 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:33.677771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mrtf4_cb865568-f767-42cf-8e4a-419a6dab79c9/manager/0.log"
Jul 14 01:51:33.857846 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:33.857805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc876bb4c-kf76m_d9b03b74-6bcd-4d52-8515-4d3d56ece46b/manager/0.log"
Jul 14 01:51:33.873266 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:33.873244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc876bb4c-kf76m_d9b03b74-6bcd-4d52-8515-4d3d56ece46b/copy-manifests/0.log"
Jul 14 01:51:34.005594 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:34.005520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-njqhj/perf-node-gather-daemonset-9n5rm"
Jul 14 01:51:36.981323 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:36.981284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d697d898-p7psj_48c8bb7f-7ad5-4924-a52d-4575132cad43/kube-auth-proxy/0.log"
Jul 14 01:51:37.017988 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:37.017954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/0.log"
Jul 14 01:51:37.078218 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:37.078187    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/1.log"
Jul 14 01:51:38.605139 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:38.605096    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d697d898-p7psj_48c8bb7f-7ad5-4924-a52d-4575132cad43/kube-auth-proxy/0.log"
Jul 14 01:51:38.636996 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:38.636962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/0.log"
Jul 14 01:51:38.691020 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:38.690979    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-p6hms_cf686d42-ad0c-4344-9487-388bff418267/istio-proxy/1.log"
Jul 14 01:51:41.776214 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.776182    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/kube-multus-additional-cni-plugins/0.log"
Jul 14 01:51:41.792485 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.792453    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/egress-router-binary-copy/0.log"
Jul 14 01:51:41.807340 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.807314    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/cni-plugins/0.log"
Jul 14 01:51:41.822671 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.822643    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/bond-cni-plugin/0.log"
Jul 14 01:51:41.838538 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.838507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/routeoverride-cni/0.log"
Jul 14 01:51:41.854282 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.854259    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/whereabouts-cni-bincopy/0.log"
Jul 14 01:51:41.869238 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:41.869212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fcklr_2e2b88b3-1b07-4d05-9bcf-471cb7ae9066/whereabouts-cni/0.log"
Jul 14 01:51:42.051791 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:42.051721    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qsk57_0c96a14e-94d4-4016-882f-a62c7eeee44a/kube-multus/0.log"
Jul 14 01:51:42.073029 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:42.072992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2f7j6_d324260d-db38-4bfb-8e21-bf894cd91a92/network-metrics-daemon/0.log"
Jul 14 01:51:42.085497 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:42.085471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2f7j6_d324260d-db38-4bfb-8e21-bf894cd91a92/kube-rbac-proxy/0.log"
Jul 14 01:51:43.053833 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.053787    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-controller/0.log"
Jul 14 01:51:43.065968 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.065938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/0.log"
Jul 14 01:51:43.066174 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.066097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovn-acl-logging/1.log"
Jul 14 01:51:43.087851 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.087817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/kube-rbac-proxy-node/0.log"
Jul 14 01:51:43.109799 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.109764    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/kube-rbac-proxy-ovn-metrics/0.log"
Jul 14 01:51:43.122239 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.122213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/northd/0.log"
Jul 14 01:51:43.139677 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.139650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/nbdb/0.log"
Jul 14 01:51:43.157613 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.157588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/sbdb/0.log"
Jul 14 01:51:43.242330 ip-10-0-137-153 kubenswrapper[2565]: I0714 01:51:43.242298    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmcbl_55babe6b-803b-4816-9d0c-51071969dd69/ovnkube-controller/0.log"